PhiladelphiaRecruiter Since 2001
the smart solution for Philadelphia jobs

Data Bricks DevOps Engineer

Company: Spiceorb
Location: Philadelphia
Posted on: November 22, 2021

Job Description:

Data Bricks DevOps EngineerJob Location:- Philadelphia, PA UST is looking for talented and creative Data Bricks DevOps Engineer who takes responsibility and ownership in providing software solutions and contributing to the overall success of the team. Responsibilities: Works as part of a lean agile DevOps team to deliver business solutions within Xfinity Mobile Designing and Implementing highly performant data ingestion pipelines from multiples sources using Apache Spark and/or Azure Accelerate the rate at which your colleagues iterate on code and deliver features to customers using the Databricks Platform or Databricks Runtime Interacts with Architects, Business Owners, 3rd party vendors and, Peer DevOps teams to deeply understand the data flow and business use cases Improve efficiency and productivity across the entire organization. Develop tools to be fast, CLIs intuitive, giving your colleagues (and yourself) the best experience possible Passionate for automation through automated workflows, automated testing, automated deployments, automated monitoring. Basically to automate away any tedious work Comfortable in a heterogeneous environment and able to quickly learn new technologies. The team deals with a variety of environments from Kubernetes services to Jenkins automation, Scala libraries to Python scripting, writing graph algorithms to debugging 3rd-party Javascript, Dev-Tools does it all. Able to quickly learn different codebases, dive into unfamiliar third-party projects (in unfamiliar languages!), and driving to go beyond what they say you can do 'on the box ' Become an expert in many more systems, languages, and tools than you may normally be comfortable with Application performance tuning- TCP/IP and networking technologies and protocols

  • Responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
  • Work closely with the database team, network team, BI team, and application teams to make sure that all the big data applications are highly available and performing as expected. Requirements /Tech Stack:
    • Experience with setup all the configurations- Core-Site, HDFS-Site, YARN-Site and Map Red-Site.
    • At least 5+ years Linux Red Hat Linux systems administrator, including designing, deploying, administering, troubleshooting, and tuning Linux systems in a medium to large enterprise environment
    • At least 3 plus years' experience in application integration and automation with strong working knowledge of the following technologies / products / methodologies. Competencies Minimum: A collaborative mindset and good communication skills Must have AWS Databricks with experience in Data Integrations Must be Strong in SQL SPARK/JAVA skills. Experience Performance Tuning of Spark SQL running on DATA LAKE storage Strong Knowledge on Databricks and Cluster Configurations. Strong understanding on Data Warehousing, Data Model, Data Validation, Data Migration Strong working knowledge of Linux OS Working knowledge in Python, Spark, Java Working knowledge of Scala a plus Should have experience in any other ETL tool and projects Working Experience with build systems Experience with Continuous Integration/Continuous Deployment frameworks Experience with container technologies, such as Docker Experience with monitoring frameworks for large systems Experience with cloud APIs (e.g., a public cloud such as AWS) by Jobble

Keywords: Spiceorb, Philadelphia , Data Bricks DevOps Engineer, Engineering , Philadelphia, Pennsylvania

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest Pennsylvania jobs by following @recnetPA on Twitter!

Philadelphia RSS job feeds