Job description
Senior Data Engineer is the backbone of the companys core data infrastructure that powers all analytics products running on our SaaS platform. Leverage AWS expertise to manage a wide array of cloud compute services like AWS Lambda as well as managing database solutions like AWS DynamoDB and AWS Neptune in order to compute results quickly. Extensive Datadog and AWS Cloudwatch monitoring to ensure that all aspects of infrastructure stays running as expected and niche data governance methods are applied to ensure that data outcomes remain consistent. Perform data modelling and database structuring. Create highly scalable and efficient ETL pipelines to populate our advanced data lake. Position is fixed location based in Johns Creek, GA office; however, telecommuting from a home office may also be allowed.
Education and Experience Requirements
Job Requirements:
Requires a Masters degree (or foreign equivalent) in Information Systems or a directly related field plus four (4) years of experience in a Data Engineering role. Experience must include:
Four (4) years of experience in the following (experience may be gained concurrently):
- Petabyte-sized Data Lakes
- Deep AWS experience building end-to-end data applications
- Spark experience (RDDs, DataFrames, low-level optimizations)
- Spark optimization tools (Ganglia, Log4J, Spark UI)
- Data warehousing
- Data modeling experience
- SQL development
- Python
Three (3) years of experience in the following (experience may be gained concurrently):
- Snowflake experience
- AWS Athena serverless data warehousing
One (1) year of experience in the following (experience may be gained concurrently):
- Hadoop ecosystem
- Hive and Presto
- YARN resource management
40 hours/week, 9:30am-5:30pm, Salary: $160,056k - $165k/year.
Telecommuting from a home office may also be allowed
Please copy and paste your resume in the email body (do not send attachments, we cannot open them) and email it to candidates at (link removed) with reference in the subject line.
Thank you.
Education and Experience Requirements
Job Requirements:
Requires a Masters degree (or foreign equivalent) in Information Systems or a directly related field plus four (4) years of experience in a Data Engineering role. Experience must include:
Four (4) years of experience in the following (experience may be gained concurrently):
- Petabyte-sized Data Lakes
- Deep AWS experience building end-to-end data applications
- Spark experience (RDDs, DataFrames, low-level optimizations)
- Spark optimization tools (Ganglia, Log4J, Spark UI)
- Data warehousing
- Data modeling experience
- SQL development
- Python
Three (3) years of experience in the following (experience may be gained concurrently):
- Snowflake experience
- AWS Athena serverless data warehousing
One (1) year of experience in the following (experience may be gained concurrently):
- Hadoop ecosystem
- Hive and Presto
- YARN resource management
40 hours/week, 9:30am-5:30pm, Salary: $160,056k - $165k/year.
Telecommuting from a home office may also be allowed
Please copy and paste your resume in the email body (do not send attachments, we cannot open them) and email it to candidates at (link removed) with reference in the subject line.
Thank you.
Apply for this job
You'll be taken to the employer's application page.