Senior Data Engineer
IHS Markit
- Location
- Hyderabad, India
- Employment
- Full Time
- Work model
- On-Site
- Level
- Senior
Skills
About this role
About the Role
Grade Level (for internal use): 10 The Team: Step into a dynamic team at the cutting edge of data innovation! You’ll collaborate daily with talented professionals from around the world, designing and developing next-generation data products for our clients. Our team thrives on a diverse toolkit that evolves with emerging technologies, offering you the chance to work in a vibrant, global environment that fosters creativity and teamwork. Responsibilities & Impact: Architect and develop scalable Bigdata and cloud applications, harnessing a range of cloud services to create robust, high-performing solutions. Design and implement advanced CI/CD pipelines, automating software delivery for fast, reliable deployments that keep us ahead of the curve. Tackle complex challenges head-on, troubleshooting and resolving issues to ensure our products run flawlessly for clients. Lead by example, providing technical guidance and mentoring to your team, driving innovation and embracing new processes. Deliver top-tier code and detailed system design documents, setting the standard with technical walkthroughs that inspire excellence. Bridge the gap between technical and non-technical stakeholders, turning complex requirements into elegant, actionable solutions. Mentor junior developers, nurturing their growth and helping them build skills and careers under your leadership. What We’re Looking For: We’re seeking a passionate and experienced professional who brings: 5 -7 years of expertise in designing and building data-intensive solutions using distributed computing, with a proven track record of scalable architecture design. 4+ years of hands-on experience with Python, PySpark /Hadoop, and data/workflow orchestration tools, demonstrating technical versatility. Proficiency in SQL, NoSQL, Apache Spark, Airflow, or similar tools , with deep experience operationalizing data pipelines for large-scale batch and stream processing. Extensive experience deploying data engineering solutions in public cloud environments like GCP or AWS , leveraging cloud capabilities to their fullest potential. A strong history of collaborating with business stakeholders and users to shape research directions and deliver robust, maintainable products. A talent for rapid prototyping and iteration , delivering high-quality solutions under tight deadlines. Exceptional communication and documentation skills , with the ability to explain complex ideas to both technical and non-technical audiences. Good to have skills : Strong knowledge of Gen AI tools (e.g., GitHub Copilot, ChatGPT, Claude, or Gemini) and their power to boost developer productivity. Advanced programming skills in Java or Scala, supported by a portfolio of impactful projects Expertise in containerization, scripting and CI/CD practices, ready to shine in a modern development ecosystem. What’s In It For You?
Our Mission
Advancing Essential Intelligence. Our People: We're more than 35,000 strong worldwide—so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We’re committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. Join us and help create the critical insights that truly make a difference.
Our Values
Integrity, Discovery, Partnership Throughout our history, the world's leading organizations