Data Engineer in California

Responsibilities:

• Lead a global SRE team for Data Platform, distributed across the US and Singapore. Responsible for the reliability of all major data warehouse products, services, and query engines, such as ClickHouse, Spark, Presto, Doris, etc.
• Uphold Service Level Agreements (SLAs): Ensure that all service level objectives and agreements from ByteDance's Data Platform services are met. Lead team members to respond promptly to any system outages or issues.
• Continuous Performance Optimization: Lead the team to deeply analyze service performance and reliability patterns to identify potential performance bottlenecks. Implement proactive measures to prevent service disruptions. Work with development teams to optimize application performance, ensuring that services run efficiently and those resources are utilized effectively.
• Incident Management: Build robust incident management mechanism. Lead efforts to troubleshoot and resolve...

Are you passionate about building and optimizing data pipelines that drive data-driven decision-making in cloud environments? Do you have the technical expertise to design robust data architectures that manage large-scale data processing and ensure seamless data flow? If you’re ready to harness the power of cloud technology to create scalable data solutions, our client has the ideal role for you. We’re seeking a Cloud Data Engineer (aka The Data Pipeline Architect) to design, develop, and manage cloud-based data infrastructures that support analytical and operational needs across the organization.

As a Cloud Data Engineer at our client, you’ll collaborate with data scientists, analysts, and software engineers to build data pipelines and storage solutions that are secure, efficient, and scalable. Your role will be vital in ensuring that data systems are optimized for performance and capable of supporting a range of data-driven...

Are you passionate about building data infrastructure that powers advanced analytics and machine learning? Do you thrive on transforming raw data into well-organized, accessible, and reliable datasets that fuel data-driven decision-making? If you’re excited about working with cutting-edge data technologies and architecting scalable pipelines, then our client has an exciting opportunity for you. We’re looking for a Data Engineer (aka The Data Pipeline Architect) to design, develop, and optimize the data systems that form the backbone of our products.

As a Data Engineer at our client, you’ll be responsible for constructing efficient, scalable data pipelines, ensuring data is accessible and usable for analysts, data scientists, and business stakeholders. You’ll work with large datasets, implement ETL processes, and build the infrastructure that powers analytics and AI-driven insights.

Key...

***Must be located in the SF Bay Area or your application will not be considered***

Our client is a venture-backed SaaS startup that recently secured Series A funding. They're solving a multi-billion dollar problem of data quality for the entire marketing industry. Their platform enables major brands and publishers to optimize consumer data quality, improving marketing ROI. In a fast-paced and collaborative environment, they are committed to excellence and innovation.

Key Responsibilities:

• Design and maintain scalable data pipelines using Spark and AWS EMR for processing terabytes of consumer data

• Write, test, and optimize custom Scala code for ETL workflows
• Deploy and manage ETL processes in AWS cloud environments using Airflow
• Automate delivery of structured data to enterprise clients via Snowflake and Databricks
• Collaborate with the Data Science team to optimize...

Position Summary:

This individual will be an expert in data warehouse design, data modeling, and building and managing ETL data pipelines. Additionally, the data engineer will possess advanced knowledge and hands-on experience with data analysis and performance optimization.  This individual will also need to guarantee compliance with data governance and data security requirements. The data engineer will be the key interface in operationalizing data and analytics on behalf of the Informatics team. In this role the data engineer will work closely with their Informatics teammates, the larger IS department, and the broader business team with frequent interaction with executive leadership.

Compliance with Regulations:

Work closely with all departments to ensure processes, programs, and services are accomplished in a timely and efficient manner in accordance with CHG policies and procedures and in compliance...

Millennium Health LLC is an accredited specialty laboratory with more than a decade of experience in medication monitoring and drug testing services, helping clinicians monitor the use and misuse of prescription medications and illicit drugs. The testing is used by healthcare professionals to obtain objective information about patients’ recent use of prescription medications and/or illicit drugs and helps monitor the effectiveness of treatment plans.

The Data Engineer will be responsible for the testing, analysis, development and maintenance of data pipeline processes and applications. The position will be about 80% testing and validation of Data Services processes and 20% development. Previous experience using ETL software is desirable. Ideal candidates will be passionate about exceeding client expectations and is driven to learn new data engineering technologies. In addition, candidates must be able to understand complex data structures, and will have a strong...

Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending autonomous mobility technologies and services at a rapidly expanding footprint of sites around the world. Operating Robotaxi, Robotruck and Personally Owned Vehicles (POV) business units, Pony.ai is an industry leader in the commercialization of autonomous driving and is committed to developing the safest autonomous driving capabilities on a global scale. Pony.ai’s leading position has been recognized, with CNBC ranking Pony.ai #10 on its CNBC Disruptor list of the 50 most innovative and disruptive tech companies of 2022. In June 2023, Pony.ai was recognized on the XPRIZE and Bessemer Venture Partners inaugural “XB100” 2023 list of the world’s top 100 private deep tech companies, ranking #12 globally. As of August 2023, Pony.ai has accumulated nearly 15 million miles of autonomous driving globally.

Responsibility

As a...

Gridware exists to enhance and protect the mother of all networks: the electrical grid. The grid touches everything, and when it grinds to a halt, the consequences can be dire: wildfires burn, land is destroyed, property is damaged, progress stops, and lives are lost.

Our team engineers an advanced sensing system to continuously analyze both the electrical and mechanical behavior of grid assets. Utilizing high-precision sensor arrays, the system identifies and allows preemptive mitigation of faults. The technology has been proven with utilities to bolster safety, reliability, and reduce customer outage durations. The demand for power will only increase. We protect the grid of today while we build the grid of tomorrow.

Gridware is privately held and backed by the best climate-tech and Silicon Valley investors. We are headquartered in the Bay Area in northern California.

Role Description:

The Senior Data Engineer is responsible for...

Connexity is a performance-marketing technology company whose core purpose is to help online retailers find new customers and drive sales at a cost that meets ROI objectives. As the leading independent source of new customers and sales for online retailers, we manage the complexities of a wide range of customer acquisition channels on behalf of thousands of retailers, with 20+ years of proven success in the US and in Europe. Our Engineers develop next-generation technologies that help retailers reach those qualified consumers.

We have an opportunity available for an experienced back-end Sr. Software Engineer, that is passionate about building reliable, loosely coupled systems while prioritizing security and performance. A good match for this position is someone who is skilled in problem-solving, cares about code quality, keeps up-to-date on industry best practices, is strategic in their vision and tactical in their execution....

Come join VisitorsCoverage, one of Silicon Valley's most successful InsurTech companies, certified as a Great Place to Work®!

We are looking for a Data Engineer with GA4 / Tableau experience to join our Marketing team. If you are experienced with reporting website analytics and building data pipelines, we’d love to have you at VisitorsCoverage. This contract role will offer the right candidate first-hand experience in a booming industry. A successful candidate will be responsible for streamlining reporting and data aggregation with GA4 and other 3rd party marketing tools. You’ll lead and assist in building visualizations, dashboards, running SQL queries, creating and managing tags in Google Tag Manager.

What We Do:

VisitorsCoverage is an Insurtech company, located in the heart of Silicon Valley, revolutionizing the way travelers search, compare, purchase, and manage their travel...

The Senior Data Security Engineer will be responsible for designing, implementing, and managing the security of our data platform. This role involves working closely with our Data Platform team to ensure the confidentiality, integrity, and availability of our data systems. The ideal candidate will have a strong background in data security, a deep understanding of backend data engineering, and experience with Databricks. You will collaborate closely with data scientists, data engineers and other stakeholders to ensure seamless data integration, security and delivery. Additionally, you will provide technical leadership, mentorship, and guidance to junior members of the data engineering team.

Essential Duties and Responsibilities

• Security Design and Implementation: Develop and implement security policies, procedures, and controls to protect our data infrastructure from threats and vulnerabilities. 
• Data Encryption...

Come join VisitorsCoverage, one of Silicon Valley's most successful InsurTech companies, certified as a Great Place to Work®!

We are looking for a Marketing Data Engineer to join our team. This contract role will offer the right candidate first-hand experience in a booming industry. A successful candidate will be responsible for streamlining reporting and data aggregation with GA4 and other 3rd party marketing tools. You’ll lead and assist in building visualizations, dashboards, running SQL queries, and creating and managing tags in Google Tag Manager.

What We Do:

VisitorsCoverage is an Insurtech company, located in the heart of Silicon Valley, revolutionizing the way travelers search, compare, purchase, and manage their travel insurance. Imagine a place where buying travel insurance is as easy as ordering an item from your favorite online retailer. You know exactly what the benefits are and what each word on the coverage document means,...

Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and be part of a dynamic team shaping the future of data systems engineering.

Position Overview: As a Senior Data Systems Engineer, you'll play a critical role in designing, building, and optimizing our data systems infrastructure. You'll work on challenging projects, from architecting data storage solutions to implementing data processing frameworks, to support the needs of our data-driven organization. If you're a seasoned engineer with expertise in data systems technologies and a passion for building scalable and reliable data systems, we want you on our...

Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business intelligence. Join us and lead our team in shaping the future of data engineering.

Position Overview: As the Lead Data Engineer, you'll be responsible for leading our data engineering efforts and driving the design, development, and maintenance of our data infrastructure and pipelines. You'll lead a team of talented data engineers and collaborate closely with cross-functional teams to deliver end-to-end data solutions that support the needs of our data-driven organization. If you're a seasoned data engineer with expertise in data engineering technologies and a track record of leading successful data projects,...

Company Overview: Welcome to the forefront of data-driven innovation! Our company is a trailblazer in leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge cloud data solutions that harness the scalability, flexibility, and power of cloud platforms. Join us and lead our efforts in shaping the future of cloud data engineering.

Position Overview: As the Lead Cloud Data Engineer, you'll spearhead our initiatives in designing, building, and optimizing cloud data solutions. You'll lead a team of skilled engineers, collaborating closely with cross-functional teams to deliver high-quality, scalable, and cost-effective data solutions. If you're a seasoned engineer with expertise in cloud data technologies and a proven track record of leadership in delivering successful data projects, we invite you to lead our team in this exciting...

Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of big data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge big data solutions that enable advanced analytics, machine learning, and business intelligence. Join us and lead our team in shaping the future of big data engineering.

Position Overview: As the Lead Big Data Engineer, you'll be at the forefront of our big data engineering efforts, leading a team of talented engineers to design, build, and maintain our big data infrastructure and pipelines. You'll drive the development of scalable and efficient data solutions that support the needs of our data-driven organization. If you're a seasoned engineer with expertise in big data technologies and a track record of leading successful data projects, we want you on our...

Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of real-time data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge real-time data solutions that enable timely insights and actions. Join us and be part of a dynamic team shaping the future of real-time data engineering.

Position Overview: As a Senior Real-Time Data Engineer, you'll play a crucial role in designing, building, and optimizing our real-time data infrastructure. You'll work on challenging projects, from architecting data streaming pipelines to developing real-time analytics systems, to support the needs of our data-driven organization. If you're a seasoned engineer with expertise in real-time data technologies and a passion for building scalable and reliable systems, we want you on our...

Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and efficient data warehousing solutions that enable advanced analytics, reporting, and business intelligence. Join us and be part of a dynamic team shaping the future of data warehouse engineering.

Position Overview: As a Senior Data Warehouse Engineer, you'll play a critical role in designing, building, and maintaining our data warehousing solutions. You'll work on challenging projects, from data modeling and ETL processes to performance optimization and data governance, to support the needs of our data-driven organization. If you're a seasoned engineer with expertise in data warehousing technologies and a passion for building robust data systems, we want you on our...

Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to leveraging the power of data to drive transformative change and solve complex problems across industries. We're committed to building cutting-edge data systems that enable efficient data management, processing, and analysis. Join us and lead our efforts in shaping the future of data systems engineering.

Position Overview: As the Lead Data Systems Engineer, you will play a pivotal role in leading our data systems engineering initiatives and driving the design, implementation, and optimization of our data systems infrastructure. You will lead a team of skilled engineers, collaborating closely with cross-functional teams to deliver high-quality, scalable, and reliable data systems solutions that meet the evolving needs of our data-driven organization. If you're a seasoned engineer with expertise in data systems technologies and a proven track...

Company Overview: Welcome to the cutting-edge of data systems engineering! At our company, we're passionate about harnessing the potential of data to drive innovation and transformation. Our mission is to develop robust and scalable data systems that empower organizations to extract insights and make data-driven decisions. Join us and be part of a dynamic team committed to shaping the future of data systems engineering.

Position Overview: As a Data Systems Engineer, you'll be at the forefront of designing, building, and optimizing our data systems infrastructure. Working closely with cross-functional teams of data scientists, software engineers, and business analysts, you'll ensure the reliability, scalability, and efficiency of our data systems. If you're passionate about data engineering and eager to tackle complex challenges in data infrastructure, we want you on our team.

Requirements

Key...

Company Overview: Welcome to the forefront of cloud data engineering! At our company, we're dedicated to leveraging the power of cloud technology to drive data-driven innovation. Our mission is to develop scalable and robust cloud data solutions that enable organizations to harness the full potential of their data. Join us and be part of a dynamic team committed to shaping the future of cloud data engineering.

Position Overview: As a Cloud Data Engineer, you'll play a pivotal role in designing, building, and maintaining our cloud-based data infrastructure and systems. Working closely with cross-functional teams of data engineers, architects, and business stakeholders, you'll ensure the reliability, scalability, and efficiency of our cloud data solutions. If you're passionate about cloud technology and eager to drive innovation through scalable data solutions, we want you on our...

Company Overview: Welcome to the forefront of data-driven innovation! Our company is dedicated to harnessing the power of data to drive transformative change and solve complex problems across industries. We're committed to building scalable and reliable data infrastructure that enables advanced analytics, machine learning, and business intelligence. Join us and be part of a dynamic team shaping the future of data engineering.

Position Overview: As a Senior Data Engineer, you'll play a critical role in designing, building, and maintaining our data infrastructure and pipelines. You'll work on challenging projects, from data ingestion and processing to data storage and retrieval, to support the needs of our data-driven organization. If you're a seasoned engineer with expertise in data engineering technologies and a passion for building robust data systems, we want you on our team.

Requirements

Key...