Big Data Developer-am/manager-bangalore

4 - 9 Years

Job Description

Job Description

Position Title, Responsibility Level
Senior Big Data Developer / Lead Function
Data Integration Reports to
Big Data Architect
Permanent/ Temporary
Permanent Span of Control
TBD Location
Off Shore / India

Basic Function

The Senior Big Data Developer works closely with the Big Data Architect to translate the customer's business requirements into a Big Data solution. This includes understanding the customer data requirements, design of the application and interfaces, and development, testing, and deployment of the proposed solution. Has the ability to design large-scale data processing systems and help identify the best practices in design and development. The Senior Big Data Developer is also understands the complexity of data and can design systems and models to handle different variety of data with varying levels of volume, velocity and veracity. Should have independently worked on design and data ingestion concepts in a consultative mode.

Essential Functions

Has a deep understanding and experience with several of the following: Business Analysis, Requirements Gathering, Data Analysis, Data Modeling
Advanced knowledge of design and development methodologies.
Demonstrated work ethic, focus and self-discipline
Has and maintains a deep understanding of the role of big data in business and the enterprise.
Propose recommended and/or best practices regarding the movement, manipulation, and storage of data in a big data solution including data ingestion, data storage options, query techniques, data variety, volume & velocity,
Research and experiment with emerging technologies and tools related to big data.
Experience in scaling applications on big data platforms to massive size.
Long term development and Technical expertise in DW/BI Practice, communicate well with all stakeholders, optimize objectives, leverage state of the art tools and best practices, integrate into corporate systems and deliver on time.
Deep understanding in Data Warehousing, Dimensional Modelling ,Star & Snow-flake schema design, Reference DW Architectures, ETL Architect, ETL (Extract/Transform/Load), Data Analysis, Data Conversion/Transformation, Database Design, Data Warehouse Optimization, Data Mart Development, and Enterprise Data Warehouse Maintenance and Support etc.
Should have independently worked on proposing design and data ingestion concepts.

Primary Internal Interactions

Project Delivery

Leads big data development teams in documenting and implementing technical solutions for business problems
Works with Big Data Architect to estimate big data design and development work.
Works with Big Data Architect ensuring appropriate timely delivery of artifacts.

Account & Resource Management


Primary External Interactions

Assessment Participation & Leadership


Organizational Relationships

Reports To : Big Data Architect
Supervises : NA

Technical Skills (Knowledge, Skills & Abilities) Experience with enterprise data management, Business Intelligence, data integration, and SQL database implementations
Experience with the major big data solutions like Hadoop, MapReduce, Hive, Spark, Scala, HBase, MongoDB, Cassandra.
Programming/scripting languages like Java, Linux, PHP, Ruby, Python and/or R. As well as have experience in working with ETL tools such as Informatica, Talend, Pentaho etc.
He or she should have experience in designing solutions for multiple large data warehouses with a good understanding of cluster and parallel architecture as well as high-scale or distributed RDBMS and/or knowledge on NoSQL platforms.
Experience in data migration from relational databases to Hadoop HDFS
Propose best practices/standards
Translate, load and present disparate datasets in multiple formats/sources including JSON, XML etc.

Must Have Skills:
Hadoop stack including HDFS cluster, MapReduce, Hive, Spark and Impala
Web Technologies CSS, DHTML, XML, Hight Charts, Linux
ETL tools such as Informatica, Talend and/or Pentaho.
Query : SQL, No SQL Concepts
Ingest : Kafka, Sqoop, Flume
Orchestration : Zookeeper
Databases : Postgres, Mongo DB, Cassandra, HBase
Languages : Java, Scala
Scripting : JavaScript, DHTML, XML, Shell

Good to have Skills :
Core : AWS, Hadoop, Yarn
Process : Agile-Scrum, Iterative Development, DevOps, CI
Analytics : Descriptive, Predictive (Added advantage)
Tools : Jenkins and TFS
Languages : Python, Java Enterprise

Process Specific Skills
(Supervisory Responsibilities)
Senior Big Data Developer will be responsible for coaching and advising big data team members

Soft skills (Desired) Experience working with multi-divisional business communities to leverage information across the enterprise to improve business effectiveness
Strong team building, interpersonal, analytical, problem identification and resolution skills
Soft Skills (Minimum) Exceptional analytical, conceptual, and problem-solving abilities
Strong written/oral communication and presentation/interpersonal skills
Highly self-motivated and able to work independently as well as in a team environment

Education Requirements
Bachelors degree or Master's degree

Work Experience Requirements

5 to 8 years of professional experience with BI/DW implementations and with at least 2-3 years of Big Data Design and Development experience.

Please share your profile on the below email id.


Salary: Not Disclosed by Recruiter

Industry:Banking / Financial Services / Broking

Employment Type:Permanent Job, Full Time

Key Skills

Desired Candidate Profile

Please refer to the Job description above

Company Profile

M/s Gi Human Resources And Services Pvt. Ltd.
Staffing Firm
View Contact Details+

Recruiter Name:Ishika Jain

Contact Company:M/s Gi Human Resources And Services Pvt. Ltd.