Data Engineer - Java
Overview
We're looking for a Data Engineer - Java. Headquartered in Los Angeles, California, Right Balance provides top-tier technology talent for innovative companies in the US. We’re in the top 50 companies to watch in LA.
Engagement Details
Our client is a global technology consultancy focused on designing and implementing secure, observable cloud architectures embracing an Everything as Code (EAC) approach so our clients can focus on their business goals. We can provide strategy, design, implementation, and follow-the-sun support. We also create custom software products when there are missing links in current solutions.
Their areas of expertise are data-intensive cloud applications supported by RDBMS and NoSQL solutions, CI/CD using DevOps and DevSecOps pipelines, total observability from client to application in the cloud, and hybrid architectures.
They are an AWS Advanced Partner and a Datadog Gold Partner and are proud to share their learnings with the technology community. They believe the difference between something good and something great is attention to detail.
The end client is a large US Fintech company.
About the Role:
We are seeking a skilled data engineer - Java to join our team and help shape the future of data management and analytics for our organization. The job consists of setting up Change Data Capture (or CDC) for multiple types of databases for the purpose of hydrating a data lake. Debezium or other CDC knowledge is required. Along with data hydration, the job requires knowledge of ETL transformations using Apache Spark, both streaming and batch processing of data.
The engineer needs to know how to work with Apache Spark Data Frames, ETL jobs, and streaming data pipelines that will orchestrate raw CDC data and transform it into usable and query-able data for analytics. Big Data concepts, including performance tuning, are a plus.
Other Details:
- Location: Reston, VA or Plano, TX.
- Client: Large Fintech.
- Modality: Hybrid, on-site 3 times a week.
- Interviews: an in-person interview will be requested.
What’s in it for you
- Learn and evolve your skills using the latest and greatest technology tools in a rapidly growing company.
- Learn from the best people around you. We constantly challenge the status quo and invent new ways of building a great product.
- Work on challenging problems, innovate, and positively impact many people's lives while having fun doing it.
Required Qualifications
- Upper-intermediate to fluent speaking and writing English. Able to have a real-time conversation.
- 5+ years of full-time hands-on Data Engineering experience.
- 4+ years of full-time hands-on Java experience.
- 3+ years of full-time hands-on Python experience.
- 3+ years of full-time hands-on AWS experience including S3, EMR, Glue Data catalog, Step Functions, Serverless/Lambda, MWAA. etc)
- 3+ years of full-time hands-on PySpark or Spark experience.
- 2+ years of full-time hands-on Apache Airflow experience.
Nice to haves
- Scala.
- Apache Hudi.
- Apache Griffin.
- AWS Deequ.
- Bachelor’s degree in Computer Science or equivalent demonstrated ability.
Frequently Asked Questions
What are your typical clients?
The majority of our clients are venture-backed startups at the growth stage. Usually, at this stage, the company already achieved a product-market fit and is looking to expand rapidly. That’s where we bring the best engineering practices, strong architecture, the latest technologies, and consistent processes to help companies scale.
What is the length of your engagements?
Most of our long-term full-time engagements last multiple years. It allows you to evolve your career with the client company taking on more responsibilities.
What’s your company size?
The Right Balance team is 60+ engineers going to 100+ by the end of the year. The current client size team is 150+ people. The timing is great to be a part of a rapidly growing team making meaningful contributions.
What happens if the engagement is completed?
Most of our engagements are long-term in nature. That said, if the current engagement is ramping down, we’ll present you with more long-term opportunities to transition into.
What are your core values?
Client First: we only win when our clients win. We treat client challenges as our own.
Ownership: we embrace responsibility, taking on challenges, getting them to completion, and enjoying getting things done.
Quality: we’re passionate about achieving quality outcomes by applying meticulous attention to detail.