Senior Data Engineer

BlueFlag is seeking an exceptional, mid- to senior-level Data Engineer to join our dynamic team. This opportunity is remote. In this role, you'll work on a diverse range of projects, from small-scale initiatives to large enterprise environments. A key focus will be contributing to a cutting-edge big data and analytics platform for the Department of Veterans Affairs. This position offers a unique opportunity to make a significant impact -- working on projects of national importance.

What You'll Do

• Design, develop, and maintain scalable ETL/ELT pipelines and systems for projects of varying sizes and complexities.
• Collaborate with cross-functional teams, consisting of data scientists, business analysts, and stakeholders, to understand data requirements and implement effective pipelines.
• Optimize SQL queries and data processing workflows to improve pipeline performance and scalability.
• Develop and optimize data storage and retrieval solutions for both structured and unstructured data
• Apply best practices in data governance, security, and privacy, giving special attention to the management of sensitive government and healthcare data.
• Define and implement data quality checks and data governance processes to ensure integrity, accuracy, and consistency.
• Perform data profiling, cleansing, and transformation tasks in support of data science and machine learning efforts
• Monitor and troubleshoot data pipeline performance across different project scales
• Lead architecture discussions with clients and team members, articulating complex solutions with clarity and confidence
• Contribute to business development activities by articulating data engineering solutions in proposals
• Stay up-to-date with the latest data engineering technologies and tools

Why Join BlueFlag

At BlueFlag, we're passionate about leveraging cutting-edge technology to make a real difference. You'll be at the forefront of cloud innovation, working on projects that directly impact people's lives. We offer a high-growth, entrepreneurial environment that values fresh ideas and authentic teamwork.

If you're ready to take your data engineering career to new heights and contribute to meaningful projects that push the boundaries of technology, we want to hear from you. Join BlueFlag and be part of a team that's shaping the future of cloud solutions!

Requirements

• Strong proficiency in Python and SQL, with experience in at least one other programming language (e.g., Java, Scala)
• Expertise developing and deploying data pipeline code
• Expertise with big data technologies such as Apache Spark, Databricks, Hadoop, or Hive.
• Proficiency in database systems and data warehousing technologies (e.g., PostgreSQL, SQL Server, Azure Synapse Analytics, Amazon Redshift)
• Experience with DevOps practices and tools, especially CI/CD processes
• Experience with Delta Lake and other file storage formats, CSV, JSON, YAML, and Parquet
• Experience monitoring and troubleshooting data pipelines
• Exposure to cloud platforms and technologies, particularly Microsoft Azure
• Adherence to general data engineering and data security best practices
• Understanding of distributed computing paradigms and concepts
• Working knowledge of containerization and orchestration technologies (e.g. Docker, Kubernetes)
• Excellent problem-solving and communication skills
• Ability to work independently and collaborate with cross-functional teams
• Bachelor's degree in computer science, information systems, or a related field
• 5+ years of professional experience in data engineering or related fields, with exposure to both small- and large-scale datasets and projects.
• US Citizen: Must be a citizen of the United States
• Security Clearance: Must be able to obtain a public trust clearance.  Must be eligible to work in the United States.

Desired

• Software engineering experience, especially in web application development
• Experience with data visualization tools such as Tableau or Power BI
• Background in healthcare data management or experience with the Department of Veterans Affairs
• Knowledge of HIPAA compliance
• Experience supporting MLOps pipelines

Benefits

• Competitive salary
• Generous annual leave and paid holidays
• Comprehensive group health and dental plans
• 401(k) with company match
• Life insurance and AD&D coverage
• Ongoing training and professional development opportunities