Hadoop Developer Job Description template and pdf with duties [2024]

Job summary 1

This is a developer’s dream job. Working on Hadoop projects with the latest technologies and software stacks. As a Hadoop Developer in our Analytics team, you will be able to design, develop, troubleshoot, and analyze moderately complex software programs and solutions for computer-based systems. You will also be working on large scale deployments using Big Data methodologies.

Duties & Responsibilities 1

special offer

Download PDF with all 10 Hadoop Developer Job Descriptions

100Hires
eBook

Free Guide:

The Ultimate guide
to recruiting

Performs moderately complex systems modeling, simulation and analysis to provide appropriate software solutions.
Develops software system testing procedures, programming and documentation to ensure standard use of procedures.
Provides input for documentation of new or existing programs to ensure information accessibility, as required.
Designs, develops, troubleshoots and analyzes software programs to ensure compatibility with hardware systems.
Customizes software based on research and customer needs as appropriate.
Coordinates and facilitates communications with other departments and/or commercial vendor(s) to investigate and resolve software matters of significance and to ensure proper functioning of systems.
- Maintains communication with management and customers regarding status of software development and problems.
- Acts as technical lead on large projects involving a particular software package(s).
- Provides the customer base with first level support.

Requirements & Skills 1

Job summary 2

We are currently seeking a Hadoop Developer who can support a government customer on an important engagement related to big data and the cloud. DoD Secret or TS clearance required.

Duties & Responsibilities 2

Working to integrate data which is largely coming from acquisition
Understand current pipelines, parse files, and put them on a common framework
- Utilize the AWS suite tools in day to day responsibilities
- Data visualization, governance, and maintenance/support
- Development by monitoring workflows, script cleanup standards, and refactoring

Requirements & Skills 2

5+ years of experience working with big data and Hadoop tools
Active Secret or TS clearance
- Linux (Red Hat) CLI and bash scripting
- Understanding and experience with the following tools: Sqoop, Oozie, HDFS, YARN, and MapReduce
- Cloudera Certified Administrator for Hadoop (CCAH) is a plus

Job summary 3

As a Hadoop Developer, you'll be required to apply your depth of knowledge and expertise to all aspects of the software development lifecycle, as well as partner continuously with your many stakeholders on a daily basis to stay focused on common goals. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative, trusting, thought-provoking environment-one that encourages diversity of thought and creative solutions that are in the best interests of our customers globally.

Duties & Responsibilities 3

Process Orientation: Establishing right SDLC practices including code reviews, pair programming and adhering to firm wide development and release standards
Relationship Building: Working closely with plan teams and business aligned technology teams.
Business Orientation: Translate complex functional and technical requirements into detailed technical designs and performing POC's.
DevOps: Working closely with operate teams, understanding JPMorgan DevOps practices and aligning releases accordingly
- Documentation: Documenting technical flows in MS Visio and Confluence.
- Communication: Good communication and interpersonal skills.
- Domain: Understanding of financial products and their flows (Equities, Fixed Income)

Requirements & Skills 3

Development (Coding) Java - 5+ years of development experience required.
Good understanding of Hadoop ecosystem Spark, HDFS, HBase and Kafka.
Strong Java development experience.
Understanding of Cloudera Management Console.
Good understanding of RDBMS and columnar databases (Oracle/Cassandra/Vertica) and SQL
Understanding of development frameworks e.g. Spring Boot
- Good hold on scripting, including Shell/Perl and Python.
- Good understanding of Testing frameworks
- Have hands-on experience in working with Hadoop distribution platforms like Hortonworks, Cloudera, MapR, and others

Job summary 4

The Hadoop Developer provides technical and development support to the government client to build and maintain a modernized Enterprise Data Warehouse (EDW) by expanding the current on-premises Hadoop cluster to accommodate an increased volume of data flowing into the enterprise data warehouse.

Duties & Responsibilities 4

Perform data formatting involves cleaning up the data.
Assign schemas and create HIVE tables.
Apply other HDFS formats and structure (Avro, Parquet, etc. ) to support fast retrieval of data, user analytics and analysis.
- Assess the suitability and quality of candidate data sets for the Data Lake and the EDW.
- Design and prepare technical specifications and guidelines.
- Act as a self-starter with the ability to take on complex projects and analyses independently.

Requirements & Skills 4

Master's degree and 12 years of experience, Bachelor's degree in computer science, or related degree and 14 years of related work experience, or 18 years of related work experience to satisfy the degree requirement.
- 2+ years of proven experience in a range of big data architectures and frameworks including Hadoop ecosystem, Java MapReduce, Pig, Hive, Spark, Impala etc...
- 2 years of proven experience working with, processing and managing large data sets (multi TB scale).
- Proven experience in ETL (Syncsort DMX-h, Ab Initio, IBM - InfoSphere Data Replication, etc.), mainframe skills, JCL.

Job summary 5

The Hadoop Developer will work on a variety of projects in the Cloudera Hadoop (CDP 7.x) environment. This individual will be required to work with both business and IT areas to develop solutions from design through implementation. The primary focus will be around Hadoop development. This individual must be willing to participant in a production on-call rotation schedule with other Hadoop developers after six months of experience and training.

Duties & Responsibilities 5

Design, develop, code, test, and debug new software or enhancements to existing software of complex software applications.
Perform maintenance on existing software products and contribute knowledge of business applications.
Contribute as necessary to the development of all project artifacts throughout the system development life cycle.
Write SQL queries and analyze existing queries for performance tuning.
- Perform post-deployment verification.
- Review the existing documentation.
- Document technical specifications.

Requirements & Skills 5

Requires a minimum of 5 years of related experience with a Bachelor’s degree; or 3 years with a Master’s degree.
- Works on problems of diverse scope where analysis of data requires evaluation of identifiable factors.
- Demonstrates good judgment in selecting methods and techniques for obtaining solutions.
- Networks with senior internal and external personnel in own area of expertise.

Job summary 6

The Hadoop Developer will perform the role of Hadoop Administrator and developer to implement and maintain an Analytics platform.

Duties & Responsibilities 6

Understand the Analytics business requirements and work with the technology team to recommend and implement the best approach to delivering solutions on the Hadoop Platform.
Ensure the Analytics platform conforms to standards
Participate in development and code reviews.
Define and support process for access to the Analytics Platform, including balancing the needs of various business/ groups with security requirements
- Work with Architecture and Development teams to understand usage patterns and work load requirements of new projects in order to ensure the Analytics Platform can meet demand.
- Develop administrator processes
- Maintain all system configuration documentation by collecting

Requirements & Skills 6

Bachelor's degree in Computer Science, Engineering, Mathematics or related discipline
A minimum of 5 years of technical experience with a focus on open source and large data implementations in the Petabyte range.
Solution expertise and technical expertise are both required for the role. Experience developing solutions for Large Commercial and Healthcare groups desired.
Solid understanding of all phases of development using multiple methodologies Hadoop Distributed Data Files System
- Working knowledge and development experience in Hadoop
- Experience is highly desired in R/ RStudio
- Desired skills SAS

Job summary 7

Are you a Hadoop Developer with experience in Hadoop technology stack? Are you looking for your next opportunity? If so, consider joining us on our mission of helping our communities achieve better health!

Duties & Responsibilities 7

Requirements & Skills 7

Job summary 8

We're looking for an experienced Hadoop Developer to join our team.

Duties & Responsibilities 8

Ensure proper metrics instrumentation in software components, to help facilitate real-time and remote troubleshooting/performance monitoring
Experience developing large scale, enterprise-class distributed systems or subsystems that require high availability, low-latency, & strong data consistency computing
- Understand and own component security analysis, including code and data flow review. Collaborate with the security team to implement and verify secure coding techniques.
- You have proven experience to understand the requirements and independently, architect, design, and building the solution.
- Strong debugging and Linux skills to help support our Operations teams.

Requirements & Skills 8

You have experience with Java, Scala, Hadoop related technologies such as Spark, Hive, Sqoop, Nifi, Distcp, Kafka
You have experience in migrating to newer versions of Hadoop related technologies
Experience with both Cloudera and Hortonworks Hadoop distributions is a plus
- Experiences in implementing Big Data processing using MapReduce algorithms and Hadoop/Spark APIs
- You have experience creating data pipelines using schedulers such as ESP dSeries Workload Automation and BMC Control-M
- You have strong experience with Agile development (Scrum, Kanban, etc.) incorporating Continuous Integration and Continuous Delivery, utilizing technologies such as GIT, Maven, Jenkins.

Job summary 9

The Hadoop Developer is responsible for driving the ingestion of Enterprise data from multiple internal and external heterogeneous sources to provide a semantically consistent view of Enterprise data (via promoting Metadata artifacts as first –class citizens). You possess a strong background and understanding of data including database structures theories, principles and practices. The Hadoop Developer is engaged from project inception to production delivery, ensuring the solution is aligned with the Enterprise Data Strategy (EDS).

Duties & Responsibilities 9

Requirements & Skills 9

2+ years working with and coding in Apache Hadoop, preferably with Hortonworks distribution.
Hadoop ecosystem (Hive, Flume, Sqoop, Hadoop API, HDFS (storage formats).
Basic Hadoop Administration experience.
Experience with NoSQL (preferably Cassandra).
2+ years Java experience.
2+ years working with relational databases (Sybase, Oracle and SQL Server) and ELT with SQL programming to write Extractor Predicates.
- Shell scripting.
- Data Flow Modeling.
- Knowledge of Linux, is a must

Job summary 10

We are looking for a Hadoop Developer.

Duties & Responsibilities 10

Requirements & Skills 10

The duties listed above are complex in nature and require a minimum of a Bachelor’s degree in computer science, computer information systems, information technology, or a closely related field, or a combination of education and experience equating to the U.S. equivalent of a Bachelor’s degree in one of the aforementioned subjects.

Hadoop Developer Job Description

Job summary 1

Duties & Responsibilities 1

Requirements & Skills 1

Job summary 2

Duties & Responsibilities 2

Requirements & Skills 2

Job summary 3

Duties & Responsibilities 3

Requirements & Skills 3

Job summary 4

Duties & Responsibilities 4

Requirements & Skills 4

Job summary 5

Duties & Responsibilities 5

Requirements & Skills 5

Job summary 6

Duties & Responsibilities 6

Requirements & Skills 6

Job summary 7

Duties & Responsibilities 7

Requirements & Skills 7

Job summary 8

Duties & Responsibilities 8

Requirements & Skills 8

Job summary 9

Duties & Responsibilities 9

Requirements & Skills 9

Job summary 10

Duties & Responsibilities 10

Requirements & Skills 10

Start Using
100hires for Free

Weekly Webinars

Hadoop Developer Job Description

Job summary 1

Duties & Responsibilities 1

Requirements & Skills 1

Job summary 2

Duties & Responsibilities 2

Requirements & Skills 2

Job summary 3

Duties & Responsibilities 3

Requirements & Skills 3

Job summary 4

Duties & Responsibilities 4

Requirements & Skills 4

Job summary 5

Duties & Responsibilities 5

Requirements & Skills 5

Job summary 6

Duties & Responsibilities 6

Requirements & Skills 6

Job summary 7

Duties & Responsibilities 7

Requirements & Skills 7

Job summary 8

Duties & Responsibilities 8

Requirements & Skills 8

Job summary 9

Duties & Responsibilities 9

Requirements & Skills 9

Job summary 10

Duties & Responsibilities 10

Requirements & Skills 10

Start Using 100hires for Free

Weekly Webinars

Start Using
100hires for Free