Lead Data Engineer

Innovien

Job Description:
One of our Fortune 500 Partners is building out its Center of Excellence for its next-generation Digital Banking Data Reporting Platform with a Lead Data Engineer. This division within this company is a leading Cloud-based solution of online and mobile banking software to financial institutions in the United States. This team will be at the forefront, building data pipelines and data systems at scale using the AWS and GCP architectures for over 600 financial institutions and 24 million end users for their Digital Banking clients! Must be located in one of the following locations: Atlanta, GA , Dallas, TX, or Omaha, NE, and willing to be onsite 2 days/week for a hybrid schedule. Apply today to connect with our team for more details!

Requirements:
• 4+ years as a Data Engineer, with strong hands-on experience building data pipelines and data systems at scale using AWS or GCP architectures
• Extensive experience building databases and data models using Apache Spark, & data cataloging tools like AWS Glue and DataProc on top of a multi-tiered data lake storage
o SQL and NoSQL databases (Ex. MySQL, Oracle, Postgres, Elasticsearch, MongoDB Atlas, BigQuery, or BigTable)
• Experience developing with Python (Java could also suffice)
• Solid understanding of Microservices and big data architectures for the use of security, machine learning, analytics, and artificial intelligence
• Experience using docker and Kubernetes containerization tools
• Experience with GitHub, GitFlow, or Jenkins

Nice to have:
• Fintech experience

Responsibilities:
• Provide technical solution leadership in data engineering team, driving technology decisions, mentoring others, and contributing significantly on an individual level developing and maintaining a big data platform
• Build frameworks to handle data at high scale using Apache Spark and data cataloging tools like AWS Glue and DataProc on top of a multi-tiered data lake storage
• Use exploration and analytic tools to probe and validate data
• Build robust data processing pipelines using AWS and GCP Services and integrate with multiple data sources
• Ability to translate data needs into detailed functional and technical designs for development, testing and implementation

We use E-Verify to confirm U.S. Employment eligibility.

  Apply with Github   Apply with Linkedin   Apply with Indeed
  Stack Overflow