Hadoop PySpark Data Pipeline Build Engineer

Company: Kforce Technology
Location: Philadelphia
Posted on: May 28, 2023

Job Description:

Kforce's client, one of the world's largest financial institutions, seeks a Hadoop PySpark Data Pipeline Build Engineer for a minimum 1-year contract with long-term opportunities in Philadelphia, PA, Charlotte, NC, Dallas, TX and Palo Alto, CA.

Responsibilities:

• The Hadoop PySpark Data Pipeline Build Engineer will be optimizing physical models based on use case needs and data access patterns, considering performance, volumes, and complexity of queries
  
• Facilitating data discovery sessions involving business subject matter experts
  
• Translating/mapping relational data models into Data Schemas
  
• Create and maintain conceptual/business, logical and physical data models
  
• Translate a logical model into a physical model, adding appropriate physical objects needed to create the database e.g. indexes
  
• Maintaining a model repository, along with enforcing logical model versioning, tied to physical schema evolution
  
• The Hadoop PySpark Data Pipeline Build Engineer will synchronize models to ensure that database structures match models
  

Keywords: Kforce Technology, Philadelphia , Hadoop PySpark Data Pipeline Build Engineer, Engineering , Philadelphia, Pennsylvania