Skip to content

feat: Merge collection-cert-pre-processor into collection-certificate-generator#221

Merged
pallakartheekreddy merged 3 commits intoSunbird-Lern:developfrom
chethann007:release-8.1.0
Jan 20, 2026
Merged

feat: Merge collection-cert-pre-processor into collection-certificate-generator#221
pallakartheekreddy merged 3 commits intoSunbird-Lern:developfrom
chethann007:release-8.1.0

Conversation

@chethann007
Copy link
Copy Markdown
Collaborator

Summary

This PR consolidates the certificate generation pipeline by merging the collection-cert-pre-processor job into the collection-certificate-generator job.

Changes Made

  • Pipeline Consolidation: Merged CollectionCertPreProcessorFn and CertificateGeneratorFunction into a single Flink job using side outputs for data flow
  • Configuration Updates:
    • Updated Kafka input topic to sunbirddev.issue.certificate.request
    • Consolidated Redis, Cassandra, and service endpoint configurations into collection-certificate-generator.conf
  • Error Handling: Implemented side output pattern for pre-processor failures, removing the need for an intermediate Kafka topic
  • Dependency Management: Added collection-cert-pre-processor as a dependency in pom.xml

sntiwari1 and others added 3 commits January 5, 2026 17:14
Issue #SBCOSS-00: Replace QueryBuilder.batch() with BatchStatement for YugabyteDB compatibility
…-generator

- Consolidate certificate generation pipeline into a single Flink job to reduce cost and latency
- Update Kafka input topic to 'sunbirddev.issue.certificate.request'
- Merge Redis, Cassandra, and service endpoint configurations into collection-certificate-generator
- Chain CollectionCertPreProcessorFn and CertificateGeneratorFunction using side outputs
- Implement side output for pre-processor failures to eliminate the intermediate Kafka topic
- Update pom.xml to include collection-cert-pre-processor as a dependency
…tionality into collection-certificate-generator by updating test configurations.
@pallakartheekreddy pallakartheekreddy merged commit 7258208 into Sunbird-Lern:develop Jan 20, 2026
4 of 5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants