RockvilleMDRecruiter Since 2001
the smart solution for Rockville jobs

Data Engineering, Lead (100% Remote)

Company: ConsultNet
Location: Rockville
Posted on: November 26, 2022

Job Description:

Big Data Engineering, Lead (Java, Python, AWS, Spark, Hive, Hadoop, SQL, EKS) Anywhere, US Long-Term Consulting Engagement (Contract) Job Description Our client is currently developing innovative new capabilities from the ground up that will transform the way their customers process and analyze data; while also giving their customers high performance, low costs, and exceptional ease-of-use. We are looking for a Big Data Engineer/Lead Data Engineering Technical expert to be involved in complex Big Data projects who will assist in identifying ways to break things and make them more sustainable for utilization (via software solutions and providing tips, recommendations, etc. to the teams they'll be working with in order to better the infrastructure, code and security behind the code that is being used in our client's environments. Responsibilities:

  • Will assist in developing solutions and coming to conclusions based on careful evaluation and analysis of our client's current environments, etc. This person will look at the different ways things are being done (software/tools wise)by our client currently, will be needed to break things and then produce tips/recommendations and solutions to theirvarious servicing teams and to the engineers working on the actual developing/engineering piece. This is not a developer role - this is a role where the person should be able to read and understand code, but they will not be the person responsible for developing the code. Duties/Responsibilities - In this role - You'll need to:
    • Benchmark systems, Analyze system bottlenecks and propose solutions to eliminate them; Clearly articulate pros and cons of various technologies and platforms
    • Document use cases, solutions and recommendations;
    • You'll develop deep expertise in areas like distributed systems, query engines, open source applications, performance optimization, and operational excellence.
    • You'll deliver large-scale, high performance production systems at the cutting edge of distributed database technology and have a significant bottom-line impact on our business results.
    • You'll have the opportunity to work with and contribute to the leading open source big data and analytic frameworks like Hadoop, Hive, Spark, EMR, Kubernetes, Presto and Athena.
    • In this role, you will have the opportunity to collaborate with senior and principal engineers who are domain experts currently working in support of our clients' organization. REQUIRED QUALIFICATIONS
      • At least 3 years of professional software development experience in: software development, including design, implementation, debugging, and support;
      • Knowledge of one or more modern programming languages such as Java/Scala, Python, C/C .;
      • Good knowledge of SQL query processing ; knowledge of distributed query engines is a plus;
      • Knowledge and experience with Linux
      • Passion and ability to debug, troubleshoot, and resolve highly complex performance and operational issues;
      • Have excellent written and verbal communication skills;
      • Willingness to learn new skills, a hunger for new knowledge and someone who's willing to embrace emerging technology, someone who is willing to be at the forefront of new technology, staying on top of industry trends and continuously enhancing their technical knowledge; PREFERRED QUALIFICATIONS:
        • Experience in open-source big data and analytic frameworks like Hadoop, Apache Hive, Apache Spark, AWS EMR, Kubernetes, AWS EKS, Presto, Amazon Athena.
        • Experience taking a lead role in building complex software systems that have been successfully delivered to customers .
        • Strong at applying data structures and algorithms to solve Big-Data challenges;
        • Experience in communicating with users, other technical teams, and product management to collect requirements, describe software product features, technical designs, and product strategy ;
        • Knowledge of professional software engineering best practices for the full software development life cycle (SDLC)
        • Bachelor's Degree in Computer Science; Master's degree in Computer Science is preferred;
        • Experiences with AWS cloud-computing infrastructure solutions is a plus
        • Willingness and ability to obtain professional certification(s) within reasonable timeframe such as AWS, Kubernetes, Apache Spark, etc. Be a part of the ConsultNet difference. As a leading national provider of IT staffing and solutions, ConsultNet delivers exceptional services to startup, midmarket and Fortune 1000 companies across North America. Since 1996, we've partnered with clients to create rewarding opportunities for our consultants, successfully building teams that have surefire results. In the past two years alone, we have placed more than 1,500 consultants in contract, contract-to-hire, or direct placement opportunities. We understand communication is key to finding the right job that matches your skills and career goals. For us, it's not just the work that we do; it's how we do the work. Our breadth of offerings extends to multiple IT positions in major markets throughout the country, see more at -

Keywords: ConsultNet, Rockville , Data Engineering, Lead (100% Remote), Engineering , Rockville, Maryland

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account

Get the latest Maryland jobs by following @recnetMD on Twitter!

Rockville RSS job feeds