AWS Data Engineer
ARFA Solutions, LLC
N/A
Job Details
Contract
Full Job Description
United Airlines
Remote
Sr. AWS Cloud Data Engineer/Architect (AWS Scala/Spark Developer)
Visa friendly
1 year ongoing contract
MUST HAVE
8+ years experience as a Data Engineer
Experience with Scala, Spark and Apache Flink streaming
AWS Cloud Development
Experience with Kafka and or other AWS streaming technologies (Apache Flink is idea and will be a start)
Python, Pyspark
SCALA IS NEEDED (PROFICIENT)
Requirements
Pluses:
Java experience
IBM MQ
Proficiency with ETL architecture.
Day to day:
Senior Scala and Spark Solutions Developer and Data Engineer capable of building a data standardized solution. Ideal candidate has extensive experience with both Data streaming and batch solutions including event-driven and microservices architecture. This is a high visibility, fast-paced key initiative that will integrate data across internal and external sources.
Responsibilities
* Designing, creating, and maintaining Scala-based data task to transform raw data into meaningful data models
* Participating in all architectural development tasks related to the data pipeline.
* Writing code in accordance with the data model requirements
* Collaborating with cross-functional teams
* Mentoring team members in Scala development and management
* Document Scala Development processes including Knowledge Documents, build and run books
* Work with business analysts to understand requirements
* Test to ensure designs are in compliance with specifications
* Debug and resolve technical issues
* Make recommendations to existing infrastructure
* Continually engage in professional development
* Develop documentation to track