Staff Data Engineer

About Clarity AI 🪴

Clarity AI is a global tech company founded in 2017 committed to bringing societal impact to markets. We leverage AI and machine learning technologies to provide investors, governments, companies, and consumers with the right data, methodologies, and tools to make more informed decisions. 

We are now a team of more than 300 highly passionate individuals from all over the world, with offices in New York, Madrid, London, Paris, and Abu Dhabi. Together, we have established Clarity AI as a leading sustainability tech company backed by investors and strategic partners such as BlackRock, SoftBank, and Deutsche Börse, who believe in us and share our goals. We are dedicated to cultivating an exceptional workplace environment. We take pride in our culture, defined by our commitment to being fact-based, diverse, transparent, meritocratic, and flexible. 

We have plans to continue growing our teams globally, so if you would like to join us on this rocket ship, keep reading! Your work will shape and guide the sustainable decisions of investors, companies and consumers worldwide.

About the Role 💻 

The Staff Data Engineer will lead the design, development, and implementation of data architectures that support our data-driven products and services. This role involves creating high-level architectural blueprints, ensuring efficient data flows, and optimizing data systems for scalability and reliability. The ideal candidate combines technical expertise in data engineering with a strategic mindset, capable of assessing when and why to apply various technologies for scalability and performance, helping shape our data infrastructure to meet the demands of a fast-paced, innovative environment.

What You’ll Be Doing 🚀

1. Data Architecture Design
• Design and oversee data architecture solutions that integrate seamlessly with our current systems and support scalability, security, and high performance.
• Develop and implement architectural patterns for efficient data validation, consumption, and storage. 
• Evaluate various tools and frameworks, understanding when they add value and when simpler approaches are more appropriate.
2. Data Pipeline and Modeling
• Transform raw data into intuitive, high-quality data models that support analytical and reporting needs across the organization. Apply scalable design patterns but avoid over-engineering, ensuring solutions remain efficient and fit-for-purpose.
3. Data Quality Assurance
•  Implement and monitor data quality checks to ensure the accuracy, completeness, and reliability of data across all systems.
4. Cross-functional Collaboration
• Work closely with engineering and product teams to understand business requirements, translating them into scalable data solutions.
• Act as a bridge between technical and non-technical stakeholders, ensuring alignment with strategic goals and effective communication of technical designs.
5. Technical Leadership
• Lead initiatives to improve data practices, from schema design to data governance, ensuring data quality, consistency, and security.
• Guide the team in experimenting with new tools and technologies thoughtfully, with a focus on understanding both the benefits and limitations of each option.
6. Performance Optimization
• Continuously evolve the data architecture for optimal performance, balancing scalability with cost-efficiency and reliability.
• Apply a pragmatic approach to performance metrics and scaling decisions, ensuring that the system remains performant without unnecessary complexity.
• Implement performance metrics to monitor system health, proposing improvements where necessary.
7. Documentation
   

• Maintain comprehensive documentation of data systems, processes, and best practices to facilitate knowledge sharing and compliance.

Requirements

What You’ll Need 👀

• Experience:
• 10+ years in data architecture, data engineering, or a related role, with hands-on experience in data modeling, schema design, and cloud-based data systems.
• Strong SQL skills and proficiency with distributed data stores.
• Proven ability to evaluate and justify the use of various big data technologies, with a strong preference for simplicity whenever possible.
• Technical Skills:
• Strong background in architectural design for large-scale applications, with a focus on microservices, distributed systems, and data pipelines in cloud environments.
• Proficiency in schema design, data modeling, and building data products.
• Proficient in at least one major programming language, preferably Python, with a software engineering mindset for writing clean, maintainable code.
• Deep understanding of architectural principles in microservices, distributed systems, and data pipeline design.
• Familiarity with containerized environments, public/private API integrations, and security best practices.
• Leadership Skills:
• Strong communication and interpersonal skills, with experience working cross-functionally.
• Proven ability to guide teams and drive complex projects to successful completion.

 

Nice To Have ✨

• Experience with Domain-Driven Design (DDD) and Bounded Contexts to help shape and organize our data products around clear, meaningful domains.
• Familiarity with Team Topologies to drive team structures that optimize flow and collaboration, ensuring alignment between teams and business goals.
• Strong understanding of Lean and Agile methodologies, with a passion for continuous improvement, applying Lean principles, and delivering high-value outcomes in an iterative manner.

What we offer 🥁

• Competitive compensation
• Equity Plans, ESOP/Phantom Stock, to share our success
• Flexibility in terms of schedules and location, whether you prefer to work from home, the office, or abroad with access to a global network of co-working spaces 
• Generous paid time off schemes that include vacation, sabbatical, religious observance and compensation days
• Private Healthcare coverage that can be extended to your family members
• Fitness and Wellness benefits covered through Wellhub
• Working from home allowances to help you set up your home office and cover monthly expenses
• Annual training budget to support your professional growth
• Regular team activities and events

More About Clarity AI ⭐

Clarity AI’s Founder and CEO, Rebeca Minguela, is a successful entrepreneur who has been recognised by prestigious institutions like the World Economic Forum as one of the most distinguished leaders under 40.

The leadership team has an international presence and is composed of professionals from leading tech, consulting, and banking firms, entrepreneurs, PhDs from top research institutions, and MBA graduates from top business schools.

Clarity AI has received several awards: 

• The Forrester New Wave - ESG Ratings, Data, and Analytics - Leaders for 2022-2024 
• Investment Week - Best Sustainable Investment Research & Ratings Provider 2023
• Fast Company - Most Innovative Companies 2023 
• European Commission | EU Seal of Excellence 2020 
• World Economic Forum - Technology Pioneer 2020
• World Economic Forum, Young Global Leader - Rebeca Minguela

By submitting an application to Clarity AI for this position you agree to Clarity AI’s Privacy Policy.

Clarity AI is committed to fostering a diverse and inclusive workplace. Clarity AI is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, ancestry, religion, sex, sexual orientation, gender identity, national origin, age, disability status, protected veteran status, or any other characteristic protected by law. If you are interested in applying for employment with Clarity AI and need special assistance or an accommodation to use our website or to apply for a position, please email people@clarity.ai. Determinations on requests for reasonable accommodation are made on a case-by-case basis.