Senior Data Engineer
Job Title: Senior Data Engineer
Job Location: Hyderabad, India
Job Type: Full-time
Work Mode: (Hybrid – we operate from the office 1 day a week as of now and might change to 2 days depending on the need).
Company : Coeo Ltd.,
About the company:
Coeo are trusted data management and analytics experts, delivering technology strategy and support for business. The team have deep technical and comraderies experience working with Microsoft Data Services to help our clients optimize their costs and maximize the benefits from their investments in these technologies. Coeo has been established for over 17 years and has offices in Reading, UK and Hyderabad, India. We are exclusively focused on Microsoft technologies. Our mission is to “help our clients predict their future” through the better use of data, technology, people, and processes. To do this our business has always focused on:
- Data Managed Services
- Data Platform Consultancy
- Analytics Consultancy
- Artificial Intelligence Consultancy
- Adoption and Change Management
But above all, Coeo’s most important asset is its people, and at Coeo we are really focused on investing time, attention, and resources into building a culture that truly values its people.
We are growing our teams in India to support our ongoing customer requirements in Managed Services, Consulting and Development.
Coeo is recruiting a strong Senior Data Engineer; we’ll give you the opportunity to grow and develop your capabilities as well as support you through Microsoft certifications. You’ll have experience in:
- Developing low to high complexity, secure, governed, high quality and efficient data pipelines from a variety of on and off premise, internal and external data sources.
- Ensuring that data is cleansed, mapped, transformed, and optimized for storage to meet requirements for business and technical use cases.
- Building data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies.
- Take all requirements into account when creating a proposal
- Understanding and evaluating the organizational impact of new technologies and digital services
- Troubleshooting and resolving issues
You may be building solutions that transform data into data lake storage areas, physical database models and reporting structures across data lakes, Datawarehouse, business intelligence systems and analytics applications. You may also be required to carry out unit testing of your own code and peer testing of others to ensure appropriate quality.
Experience
- Experience working with large, event-based, datasets in an enterprise environment.
- Minimum 6 years within an Azure or SQL Data Engineering environment
- Engineering and database skills in SQL Server and/or Azure (Data Factory, Synapse) and the associated ETL technologies.
- Experience developing, driving & maintaining Data Integration Roadmaps and best practices.
- Overall responsibility of all technical business requirements, gathering deliverables and implementation.
- Ability to deliver high-to-low level designs for Data Solutions and have a good understanding of the full data lifecycle.
- Hands-on experience in designing and developing scripts for custom ETL processes and automation in Azure Data Factory, Azure Databricks, Azure Synapse, Python, Pyspark etc.
- Hands-on experience designing and developing stored procedures/functions and leveraging ETL packages/workflows
- Expertise in Cloud related Big Data integration and infrastructure tech stack using Azure Databricks & Apache Spark framework
- Well-versed with scripting languages such as Python
- Experience in Continuous Integration / Continuous Delivery (CI/CD).
- Experience working in an agile environment and self-managing teams.
- Understanding and practical knowledge of testing techniques and tools
Desired Skills
- Big Data
- Azure
- Spark
- Python
- Azure Databricks
- Azure Synapse
- Microsoft Fabric
- Azure Data Factory
- SQL Server
Benefits
- Company bonus scheme driven by yours and our success
- Comprehensive benefits package
- We care about your wellbeing so have invested resources and training help to ensure you can be at your best with us
- Very friendly, inclusive culture, family-feel and strong camaraderie
- Company growth and new projects mean on going career progression options
- Up to date technology, so collaboration has never been easier
- Cutting edge technology projects – exciting goals ahead!
Diversity and Inclusion:
Coeo is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We welcome applicants from all backgrounds and strive to ensure that everyone feels valued, respected, and supported. If you require any adjustments or additional support during the interview process, please let us know, and we will be happy to accommodate your needs.
How to Apply:
Click Apply or visit our Careers page at www.coeo.com. or you can send your resume to krishna.chaitanya@coeo.com
Create a Job Alert
Interested in building your career at Coeo (Website)? Get future opportunities sent straight to your email.
Apply for this job
*
indicates a required field