Overview
JLL is seeking a Data Engineer to join the JLL Technologies Team, designing and building Azure Databricks-based data solutions for clients alongside senior engineers.
What you'll do
- Plan, design, develop, execute and monitor data integration and ETL/ELT pipelines that ingest, cleanse and normalize data from diverse internal and external sources to support project delivery and daily operation.
- Build, debug and optimize Databricks notebooks, PySpark/SparkSQL code and Delta Lake tables, and identify opportunities to optimize the sizing, performance and efficiency of existing processes.
- Develop ETL code, metadata definitions, data models, queries, scripts, schedules and maintenance procedures.
- Develop technical understanding of how data flows from various source systems and source types across the organization to fine tune data integration solutions.
- Articulate business requirements as a technical solution that can be designed and engineered, and consult with the business to develop documentation that ensures accurate usage and interpretation of JLL data.
- Work with batch and event-driven or streaming patterns (for example Kafka, Spark Streaming, Azure Event Hubs) under guidance, and handle structured and unstructured data in a data lake environment.
- Contribute to data management and data persistence solutions using relational and non-relational databases.
- Perform unit testing, system integration testing and regression testing, and assist with user acceptance testing.
- Use AI-assisted development tools (for example Cursor, Databricks Assistant, Claude) to improve productivity and code quality, while reviewing and validating generated output.
- Build small proofs of concept to validate approaches, and participate in Agile delivery with the wider data engineering team.
- Adhere to established standards and best practices and provide input for improvement of those processes.
- Work independently or as part of a team to deliver data warehouse ETL projects, with minimal supervision, adapting to a quickly changing environment.
- Maintain a high-volume data warehouse application.
- Handle multiple tasks simultaneously, switch between tasks and work across conflicting priorities.
What you'll need
- At least 1+ years of experience in Azure Databricks.
- Bachelor's/Master's degree in Computer Science or a related quantitative discipline from a reputed University.
- Strong ability to communicate and manage business stakeholders and drive collaboration between the business team and project teams, including application support, database and infrastructure teams across regions.
- Excellent technical, analytical, and organizational skills.
- Effective written and verbal communication skills, including technical writing.
- Azure Databricks, ETL knowledge, SQL knowledge, Python, PySpark, SparkSQL, Azure Functions, Delta Lake, Azure Data Factory, Azure DevOps CI/CD.
- Strong knowledge of the Software Development Life Cycle including requirement analysis, design, development, testing, and implementation.
- Hands-on experience in performance tuning of sources, targets, queries and pipelines.
- Ability to identify critical system health issues and flag them for discussion and resolution.
- Familiarity with common support activities including access management, object and connection management, backing up repositories, code migration across environments and performance diagnosis/improvement.
- Ability to support and co-ordinate Sev1 tickets with guidance from senior team members.
- Proven experience following standards and helping others adopt standards.
- Making sure that code is in sync across all environments.
Nice to have
- Desired: 1 to 3 years of relevant experience.
- Good to have knowledge of ADLS Gen2, Kafka stream processing, Spark Streaming, Azure Event Hubs.
- Good to have exposure to relational and non-relational databases (Azure SQL/MS SQL Server, Cosmos DB/MongoDB), including stored procedures, views and explain plans.
- Good to have knowledge of AI tools such as Cursor, Databricks Assistant and Claude.
- Good communication.
- Self-starter and willingness to learn other technology including Informatica and Go Anywhere.
- Good to have hands-on experience with Informatica PowerCenter / Informatica Cloud, Data Quality and Control-M to automate job runs, along with PowerShell / UNIX Shell scripting.
Details
- Location: On-site, Bengaluru, KA.
- Scheduled weekly hours: 40.
Read the full description and apply on the company’s own careers page.