Senior Data Engineer
Brado
Dallas, texas
Job Details
Full-time
Full Job Description
About us:
Brado is a digital marketing agency reinventing the way healthcare brands engage with people. Driven by insight, we offer precision engagement solutions that produce superior returns for our healthcare clients and better experiences for their healthcare customers.
Our Values:
At Brado, we value the individual. We believe work and life can be synergistic and should not be at odds. The joy and renewal you get from each source must fuel the other. We have and will continue to cultivate a team who celebrates our diversity of thoughts, beliefs, backgrounds, and lifestyles. We are driven by our passion to do great work with great clients that are truly changing lives.
The Role:
The Senior Data Engineer helps to architect a balanced, scalable data platform to serve our clients’ needs. You will help lead the development of data pipelines and data products necessary to enable teams across Brado to accomplish their goals. You will contribute to the vision for developing our modern data infrastructure in Microsoft Azure, utilizing related Azure data resources. You will work closely with Data Engineering senior leadership, fellow data engineers, data scientists, and software engineers to establish best practices for creating systems that will drive the data components of Brado software solutions forward.
Ideal candidates for this role will live in the St. Louis, MO or Dallas/Ft. Worth TX areas. While our day-to-day work is done remotely, our teams gather in person for intentional work.
Key Areas of Responsibility
- Identify data needs for our clients, our marketing teams, and data science team, understand specific requirements for metrics and analysis, and build efficient and scalable data pipelines to deliver efficient data-driven products.
- Assist with the design and management of the Azure technology architecture used for data storage and processing.
- Satisfy data integration and transformation requirements for moving data between applications.
- Work with Data Engineering leadership to continuously revise and improve quality controls, and standards that meet or exceed organizational expectations and regulatory requirements.
- Work with Cloud Engineering teams to drive automation efforts by utilizing Infrastructure as Code (IaC) using Terraform, as well as Configuration Management and Continuous Integration (CI) / Continuous Delivery (CD) tools such as Azure DevOps. Additionally, work with Cloud Engineering teams to monitor, secure, and configure Azure environment and applications.
Requirements
- Aligns with our values: People, Commitment, Aspiration, Trustworthiness & Impact.
- Masters’ degree or equivalent experience
- 8+ years of experience with modern data engineering development practices: designing, building, and deploying scalable data pipelines with 4+ years of experience deploying cloud native solutions.
- 6+ years of experience in data-oriented programming, including languages such as SQL, Python, Java, or Scala, and their respective standard data processing libraries.
- 5+ years of experience with major code repository solutions such as Git, Azure DevOps, or BitBucket, along with experience in delivering/deploying CI/CD solutions. Additionally, experience with both Gitflow and trunk-based development workflows will be beneficial.
- 5+ years of experience designing and developing solutions in major cloud service providers, such as Microsoft Azure, AWS, or Google Cloud Platform. Familiarity with Azure services like Azure Logic Apps and Azure Function Apps.
- 3+ years of experience using Databricks and Apache Spark or similar data pipeline tools such as Snowflake, Kafka, Fivetran, and dbt.
- 2+ years of experience building data pipelines for AI / ML models.
- Experience integrating data from 3rd party platforms like Microsoft Dynamics, Epic, Salesforce, along with other marketing automation and CRM tools, into a centralized warehouse.
- Experience integrating data into centralized warehouses using 3rd party integration tools, with native connectors to aforementioned 3rd party platforms data will be originating from.
- Experience working on teams that leverage the Agile methodology for delivery.
- Experience with software development best practices, with strong rigor in quality code development, automated testing, and data engineering best practices.
Benefits
- Health Care Plan (Medical, Dental & Vision)
- Retirement Plan (401k, IRA)
- Life Insurance (Basic, Voluntary & AD&D)
- Paid Time Off (Vacation, Sick & Public Holidays)
- Family Leave (Maternity, Paternity)
- Short Term & Long Term Disability
- Training & Development
- Work From Home