Data Engineer

At CareerUs Solutions, we are on the lookout for a talented and driven Data Engineer to join our dynamic team. With our commitment to leveraging data to drive insights and make informed decisions, this role is pivotal in building and maintaining robust data architectures that support our rapid growth and innovation. As a Data Engineer, you will work closely with data scientists, analysts, and other stakeholders to gather requirements, design data models, and implement data pipelines that will ensure clean, accessible, and performant data for analysis. You will have the opportunity to work with cutting-edge technologies and play a key role in optimizing our data strategy. The ideal candidate is someone with a solid understanding of data processing frameworks, a knack for solving complex problems, and the ability to translate business needs into technical solutions. If you have a passion for working with large datasets and a desire to impact the data landscape within the organization, we encourage you to apply and help shape the future of data at CareerUs Solutions.

Responsibilities

• Design, develop, and maintain scalable data pipelines for data collection and processing.
• Collaborate with data scientists and analysts to understand data requirements and translate them into technical specifications.
• Implement data quality checks and ensure the integrity of data across various sources.
• Optimize existing ETL processes for performance and efficiency.
• Create and maintain documentation for data architecture, processes, and data dictionaries.
• Monitor and troubleshoot data pipeline issues, providing timely resolutions and improvements.
• Stay updated with the latest trends and technologies in data engineering and data management.

Requirements

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer or in a similar role with a strong understanding of data warehousing and ETL processes.
• Proficiency in programming languages such as Python, Java, or Scala.
• Experience with data storage technologies such as SQL, NoSQL, or cloud-based storage solutions.
• Familiarity with data processing frameworks like Apache Spark, Hadoop, or similar technologies.
• Knowledge of data modeling principles and best practices.
• Strong problem-solving skills with the ability to work independently and as part of a team.