Senior Data Engineer

Position Summary:

The Senior Data Engineer is responsible for all aspects of the Company technology data lake and analytics platform built using the AWS ecosystem.  The Data Engineer collaboratively works with technology, business analyst, and product team members to design and implement innovative analytic data and AI solutions. We are seeking a unique individual that excels working in a fast-paced environment, where creativity and risk-taking are encouraged and production stability and quality is expected.  This is a great opportunity to be a key contributor to our next generation data analytic and AI development initiatives.

Essential Duties and Responsibilities:

• Define and implement a Data Lake reference architecture on AWS.
• Define the data pipeline and ingestion workflow, incorporating modeling from different data sources and types, including voice recordings.
• Design and build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python, SQL and AWS technologies.
• Build analytics tools that provide actionable insights into customer acquisition, operational efficiency, and key business performance metrics, leveraging modeling techniques for analysis.
• Assemble large, complex data sets that meet functional / non-functional business requirements
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Work with stakeholders including Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
• Create data tools for analytics and business analyst team members that assist them in building and optimizing our product into an innovative industry leader.
• Provide stewardship to maintain data quality, uphold regulatory guidelines, and data security.
• Manage the data dictionary, ensuring alignment with AI modeling terminology and standards.

Requirements

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) and working familiarity with various databases.
• Experience building and optimizing data pipelines, architectures, and small to medium data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement, utilizing AI modeling techniques for comprehensive analysis.
• Strong analytic skills related to working with structured and unstructured datasets
• Build processes supporting data transformation, data structures, metadata, dependency.
• A successful history of manipulating, processing, and extracting value from disconnected datasets, with data extraction and pattern recognition.
• We are looking for a candidate with 5 years of experience in a Data Engineer role, who has attained a degree in Computer Science, Statistics, Information Systems.
• Experience with AWS cloud services: EC2, Lake Formation, Athena, Glue, S3 Storage, IAM; Additionally: Grafana, Docker, Datahub, Salesforce.
• Demonstrated ability to work with generative AI technologies and broader AI concepts, including ChatGPT API, LangChain, vector databases, embeddings models, scoring ML models (e.g., linear regression, decision trees, neural networks), and natural language processing (NLP).
• Good to have previous MLOps practices, experience to deploy ML containers.
• Excellent verbal and written communication skills, presentation skills and relationship building skills, with the ability to convey complex AI modeling concepts to diverse audiences.
• Spanish is a plus.

Benefits

• Competitive Salary
• 401k with Match
• Health insurance
• Dental & Vision Insurance
• Life insurance
• Paid time off
• Office Snacks
• Monthly events

OPF is an Equal Opportunity Employer (EOE) and takes great pride in building a diverse work environment. Qualified applicants are considered for employment without regard to age, race, religion, gender, national origin, sexual orientation, disability, or veteran status.