Senior Software Engineer (Data Engineer)
Farrer Capital Management
New York, new york
Job Details
Full-time
Full Job Description
About Us
Farrer Capital is a rapidly expanding global commodities hedge fund, dedicated to serving institutional clients by providing market leading results.
Our goal is to produce exceptional returns facilitated by an investment research process that leverages our domain expertise across global commodity markets, supply and demand analysis and a novel AI approach.
At Farrer Capital, we foster a culture of learning and collaboration among the world's most talented investment professionals, researchers, and engineers. We’re a fully distributed, remote-first company, with our growing team located across North and South America, Australia, and Europe.
We empower our team to experiment with their ideas and create commercial solutions that propel their growth and make a real impact.
Who We Are Looking For
We are seeking a highly motivated and experienced engineer to join the Engineering team within Farrer Capital.
You will be a senior contributor of a team that strives to create state-of-the-art tools for a range of data-related activities including onboarding, analysis, sourcing, quality checking, and lifecycle management. These tools are leveraged by analysts, traders and engineers to power our downstream investment teams' processes.
We’re on a journey bringing the platform to the next level, redesigning from the ground up with a blend of open-source and internal proprietary approaches. The ideal candidate is passionate about crafting high-quality software, thrives on working with data in all its forms, focuses relentlessly on rigorous design and architecture, and possesses the drive to advance initiatives and achieve results. The ideal candidate has both deep experience as a backend software engineer and experience building upon the open-source and cloud data platform ecosystem. This team will support the use of thousands of datasets, so a client-obsessed mindset is critical; you don’t just build the best tech but go above and beyond in helping users get the most out of the systems you are building.
Farrer Capital is continuously working to maintain a modern and easy-to-use data platform. Our current tech stack includes AWS, Snowflake, Airflow, K8s, and other best-in-class tools. This team sits as part of the Core Data Platform, a small group that manages the foundational data systems leveraged by analysts and engineers to power our downstream investment teams’ processes.
Key Responsibilities
- Developing and maintaining core tools for analysts, quants, and engineers to on-board and analyse datasets that would be multi-terabyte-scale in time.
- Devise and develop solutions that capitalize on cloud-based data and distributed computing technologies to create Farrer Capital's next-generation data platform.
- Contribute thought-leadership through the full software development lifecycle from requirements gathering, through architecture, prototyping, development rollout, and support.
- Collaborating with the Farrer Capital Quantitative Research team as we design and develop unique, bespoke solutions to solve their big data challenges.
- Designing and implementing strategies and tools to monitor and validate the data quality for thousands of datasets that will be in use at Farrer Capital.
- Discovering and leveraging best-in-market 3rd party tools and cloud technologies that can help to optimise the full data pipeline from scouting to trading.
- Work within a globally-distributed yet tightly-knit engineering team. Actively contribute to feature brainstorming, technical design discussions, code reviews, and overall team engagement.
- Produce software that is comprehensible, thoroughly commented, rigorously tested, and meticulously documented.
Requirements
About You
- A degree in Computer Science or a closely related field.
- Over 5 years of professional software development experience.
- A fervent desire to build robust systems.
- Strong knowledge of software engineering best practices, and the data engineering technology ecosystem.
- Experience in building complex software systems, Python experience a real plus.
- Advanced knowledge of open-source data quality and data observability frameworks
- Intermediate or advanced knowledge of SQL and experience crafting production queries for one or more SQL database management systems.
- Familiarity with fundamental DevOps practices, including continuous integration/continuous deployment (CI/CD) and infrastructure as code.
- Experience in at least one cloud environment, with a preference for those familiar with AWS.
- A self-starter mindset, with a penchant for experimentation, a habit of asking probing questions, and the ability to thrive in a fast-paced, agile setting.
- A continuous learner, eager to gain a comprehensive understanding of large and complex systems at every level, who enjoys delving into nuanced problems, conceiving innovative solutions, and conducting thorough tests to grasp both the positive and negative outcomes.
Benefits
- Our commitment to high performance outcomes is reflected in competitive salary and performance structures.
- We’re a fully distributed, remote-first, fast-growing company offering flexibility on location. We rely heavily on our written communication skills in order to make it work.
- You will be surrounded by exceptional colleagues who embody a culture of authenticity, humility, and excellence. We encourage you to make a lasting impact on our collective culture.
We believe that diversity is critical to our success. We will not discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status.