Azure Data Engineer with ADF and pyspark and python Exp Job at DMS Vision Inc, Ohio

TWVEUHlvMDRNYnpJVTR2V3VjbTd0WGdnbWc9PQ==
  • DMS Vision Inc
  • Ohio

Job Description

Hi,
Hope you are doing well,

Please find the job description given below and let me know your interest.

Position: Azure Data Engineer ADF and pyspark and python need || Onsite in Cincinnati, OH (Local only)

Duration : 6+ month project

Location : Onsite in Cincinnati, OH (Local only)

Note:- Linkedin profile is a must.

Job Description:-

Competencies: 10+ years experience required

Digital : Microsoft Azure

Agile Way of Working

Digital : Python

  • Take ownership of stories and drive them to completion through all phases of the entire 84.51 SDLC.
  • This includes external facing and internal applications as well as process improvement activities such as
  • Develop distributed data processing data pipeline solutions
  • Orchestrate multi-step data transformation pipelines
  • Perform unit, integration, and regression testing on packaged code
  • Build transformation logic and code in an Object Oriented Programming style
  • Enhance CICD pipelines in the path to production
  • Create data quality checks for ingested and post processed data
  • Ensure data observability via alerting and monitoring of automated pipeline solutions
  • Maintain and enhance existing applications
  • Build cloud resources via infrastructure as code
  • Provide mentoring to junior team members
  • Participate in retrospective reviews
  • Participate in the estimation process for new work and releases
  • Bring new perspectives to problems
  • Be driven to improve yourself and the way things are done

Essential Skills:

  • Bachelor's degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program.
  • 2 years of proven professional data development experience
  • 2 years developing with SQL
  • Proficient with software engineering best practices
  • Proficient with data pipeline orchestration
  • Proficient with automated testing (PyTest, etc)
  • Proficient with VCS (Git, GitHub)
  • Proficient using Python frameworks
  • Proficient with Object Oriented Programming principles
  • Proficient with Java and Sprint Framework
  • Experience with distributed data processing (PySpark and/or Snowpark)
  • Experience with Data Observability
  • Experience with Data Quality checks and processes
  • Experience with Cloud Technologies Services (Azure preferred, GCP, AWS)
  • Experience with CICD
  • Experience with dependency management (Conda, venv, etc)
  • Experience with debugging enterprise applications
  • Understanding of performance tuning enterprise processes
  • Understanding of Infrastructure as Code
  • Understanding SOLID principles
  • Understanding of Agile Principles (Scrum)

Neha Kumari

Technical Recruiter | DMS VISIONS INC .

972-646-2866 | dmsvisions.com/

neha@dmsvisions.com

Job Tags

Local area,

Similar Jobs

NT Solutions Inc

OTR Company driver Job at NT Solutions Inc

 ...Company OTR Driver Drive 20232026 Equipment. Were hiring Company OTR Drivers to operate 20232026 model trucks, including Volvo, Freightliner Cascadia, International, and Mack. Get steady miles, competitive pay, modern equipment, and a team that truly supports drivers... 

Archinect

Interior Designer Job at Archinect

 ...COMPANY Kristen Pea Interiors is a full-service interior design firm specializing in high end residential interior design. We are comprised of a...  ...Paid Holidays Monday - Friday, 9:00am - 6:00pm Remote work on Fridays Location: San Francisco PHYSICAL... 

Brighthouse Financial

Leader & Actuary - Liability Management (Charlotte, NC (Hybrid) or Remote) Job at Brighthouse Financial

 ...all products. In this role, youll get to: Direct the team for annual Cash Flow Testing, working closely with the Appointed Actuary to provide output and analysis of asset and liability cash flows Track and review MAR controls for the models and output... 

Cigna

Pharmacy Technician Senior Representative- Accredo Job at Cigna

 ...experience and geographic location. This role is also anticipated to be eligible to participate in an annual bonus plan. At The Cigna Group, youll enjoy a comprehensive range of benefits, with a focus on supporting your whole health. Starting on day one of your... 

Chanel

Fragrance & Beauty Advisor Job at Chanel

 ...ambassador, achieving sales targets and enhancing client experiences. The role requires strong communication skills, a passion for luxury cosmetics, and the ability to build lasting client relationships. Competitive hourly compensation and comprehensive benefits are offered.