T

Data Engineer

Techcarrot
NewPosted today

LOCATION

Hyderabad · Onsite

EXPERIENCE

5 - 7 Years

TYPE

FullTime

SKILLS REQUIRED

Azure DatabricksSparkETL PipelinesPythonAzure DevOpsCI/CDSQLData PipelinesMicrosoft Azure

Job description

Overview

Assess complex new data sources, turn them into business insights, and support their implementation and integration into the Azure Data platform.

What you'll do

  • Collect progress updates from the Squad on a regular basis.
  • Consolidate updates into weekly project status reports and share them with the Squad Leads for review.
  • Participate in early state design and feature definition activities.
  • Implement robust data pipelines using the Microsoft Databricks stack.
  • Create reusable and scalable data pipelines.
  • Collaborate with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
  • Convey complex data insights effectively to non-technical stakeholders.
  • Develop and manage L3-level project plans with sufficient detail for tasks, milestones, and dependencies.

What you'll need

  • Knowledge and experience with relational and non-relational databases.
  • Strong analytic skills working with structured and unstructured datasets.
  • Hands-on experience in Azure Databricks utilizing Spark to develop ETL pipelines.
  • Strong proficiency in data analysis, manipulation, and statistical modeling using tools like Spark, Python, Scala, SQL, or similar languages.
  • Strong proficiency in building JIRA dashboards based on tasks.
  • Azure DevOps experience to deploy data pipelines through CI/CD.
  • Minimum 5-7 years of practical experience.
  • Bachelor's degree in computer science, software engineering, information technology, or a related field.
  • Azure cloud stack in-production experience.

Nice to have

  • Strong experience in project management.

Details

  • Locations: Hyderabad, Chennai, Noida (Uttar Pradesh), India.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Data Engineer