Minimum Experience: 6+ years
Mandatory Skill Set: Apache Calcite Development, JDBC connector, Ruby, Kotlin, Strong Java Development, Query Optimization.
About Us
CLOUDSUFI is a Data Science and Product Engineering organization building Products and Solutions for Technology and Enterprise industries. We firmly believe in the power of data to transform businesses and make better decisions. We combine unmatched experience in business processes with cutting edge infrastructure and cloud services. We partner with our customers to monetize their data and make enterprise data dance.
Job Description
CLOUDSUFI is seeking a Apache Calcite Senior Developer to produce scalable software solutions. You’ll be part of a cross-functional team that’s responsible for the full software development life cycle, from conception to deployment. As a Apache Calcite Developer, you should be comfortable around both front-end and back-end coding languages, development frameworks and third-party libraries.
Job Responsibilities:
JDBC Connector Development with Apache Calcite:
- Design & Build JDBC Connectors:
- Develop JDBC connectors for various relational and cloud-based data sources, utilizing Apache Calcite for query parsing, optimization, and execution.
- Implement custom adapters for different databases, enabling seamless data access and ensuring correct SQL translation across diverse database systems.
- Query Optimization & Rewriting:
- Leverage Apache Calcite’s query optimization features to improve query performance, including cost-based optimization, logical rewrites, and applying custom optimization rules.
- Modify Calcite’s relational algebra or add new optimization rules to meet the needs of specific data sources or performance requirements.
- Support Complex Data Operations:
- Enable complex data operations like joins, aggregations, window functions, and custom SQL transformations to be executed optimally across multiple data sources via JDBC connectors.
- Implement and extend Calcite’s relational algebra to handle specific business logic or database-specific SQL dialects.
Performance Tuning and Monitoring:
- Optimize Query Execution:
- Analyze query execution plans and leverage Calcite’s query planner to improve query efficiency and minimize execution time.
- Monitor performance bottlenecks in queries processed through JDBC connectors, and apply optimization strategies to mitigate latency or resource strain.
- Troubleshoot Performance Issues:
- Use Calcite’s explainability and profiling tools to identify and resolve performance issues related to query execution, translation, and database communication.
Development Best Practices:
- Follow best practices for test-driven development (TDD), code reviews, and CI/CD pipelines to ensure high-quality, maintainable code.
- Create unit and integration tests to validate the correctness and performance of JDBC connectors.
- Stay up to date with new releases of Apache Calcite and related technologies to incorporate the latest features and improvements into the connectors.
- Advocate for new features and improvements to the connector architecture based on changing business needs or advancements in the Calcite ecosystem.
Required Qualifications:
- 2+ years of experience working with Ruby,
- 3+ years of experience working with Kotlin
- 2+ years of experience in Java development, particularly in building JDBC connectors and working with relational databases.
- Strong experience developing JDBC connectors for relational and cloud-based databases (e.g., PostgreSQL, MySQL, Redshift, BigQuery, Snowflake).
- Working experience on Looker Ruby and Kotlin SDKs would be must
- Deep understanding of Apache Calcite’s architecture, including query planning, optimization, relational algebra, and SQL parsing.
- Strong proficiency with SQL, query optimization, and database internals to understand how queries are executed and how to improve their performance.
- Experience with cost-based optimization, logical and physical plan rewrites, and custom query optimization rules using Apache Calcite.
- Hands-on experience building SQL parsers or query translation layers for different databases using Calcite.
Non-Technical/ Behavioral competencies required:
- Must have worked with US/Europe based clients in onsite/offshore delivery model
- Should have very good verbal and written communication, technical articulation, listening and presentation skills
- Should have proven analytical and problem solving skills
- Should have demonstrated effective task prioritization, time management and internal/external stakeholder management skills
- Should be a quick learner, self starter, go-getter and team player
- Should have experience of working under stringent deadlines in a Matrix organization structure
- Should have demonstrated appreciable Organizational Citizenship Behavior (OCB) in past organizations
