Commit Graph

22 Commits

Author SHA1 Message Date
70f785ccba feat: add freeleaps-postgres-cds connector 2025-10-23 14:24:11 +08:00
zhenyus
b54ad6a1b0 chore(starrocks): increase fe resources to 2c4g and limits to 4c8g
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-09-10 11:10:57 +08:00
zhenyus
ba78fbc007 Add resource requests and limits to Kafka cluster configuration, and update KafkaUser to reference a new secret for password management. Also, enhance KafkaUser ACLs and MongoDB connector configuration for full document change streams.
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-09-05 09:40:49 +08:00
zhenyus
aa46147e33 Add SCRAM-SHA-512 authentication to Kafka cluster configuration in freeleaps-data-platform manifests.
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-09-02 11:47:58 +08:00
zhenyus
d90e0f2692 Remove Flink and Metabase manifests from the freeleaps-data-platform directory, including CRDs, RBAC configurations, deployments, and associated resources. This cleanup streamlines the project by eliminating unused components.
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-09-02 10:38:40 +08:00
zhenyus
d7c072ee6a Remove deprecated Kafka and StarRocks configurations, including README, storage classes, and Vertical Pod Autoscaler files. This cleanup prepares for a more streamlined deployment process.
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-08-21 15:52:39 +08:00
Nicolas
f6c5aa12e4 deploy metabase 2025-08-21 11:07:48 +08:00
Nicolas
c9f681e44b deploy flink 2025-08-21 10:50:07 +08:00
Nicolas
f6f464dbae rewrite readme about starrocks 2025-08-20 18:53:25 +08:00
Nicolas
44f8a10431 Deploy the StarRocks Operator and use the Operator to deploy the HA StarRocks cluster 2025-08-20 18:50:45 +08:00
Nicolas
e7ec6a4258 Installed Strimzi Kafka Operator version 0.45.0
Three Kafka nodes + Three ZooKeeper nodes
Can tolerate 1 node failure
3 replicas distributed across different nodes
Use Azure Disk SSD SCRAM-SHA-512 + ACLs
2025-08-20 17:44:55 +08:00
zhenyus
dca5cffa55 fix(flink): update resource requests and limits for jobmanager and taskmanager
- Adjusted CPU and memory requests and limits for both jobmanager and taskmanager to optimize resource allocation.
- Commented out the resourcesPreset parameter for clarity in configuration.

Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-07-04 11:03:26 +08:00
zhenyus
9c07783780 feat(kafka, pinot, star-rocks): update configurations and resource limits across multiple components
- Updated Kafka configuration to specify Kubernetes version and API versions.
- Enabled Vertical Pod Autoscaler (VPA) for Pinot and adjusted resource limits for CPU and memory.
- Removed obsolete certificate configuration for Pinot.
- Enhanced StarRocks values.yaml with comprehensive configurations for deployment, including service specifications and resource requests/limits.
- Increased timeout settings in production values for Freeleaps to improve service resilience.

Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-06-26 23:04:03 +08:00
zhenyus
c8b68afc75 feat: Update Pinot configuration and RBAC rules
- Enhanced the Pinot Helm chart values.yaml with comprehensive configurations for controller, broker, server, minion, and zookeeper components.
- Added support for pod disruption budgets and custom resource definitions in RBAC rules.
- Introduced a new script for managing Kubernetes service port forwarding, allowing users to easily forward, stop, and list active services.
- Updated helm repository list to ensure proper access to necessary charts.

Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-05-20 16:00:32 +08:00
zhenyus
db0cd26f4b feat: update RBAC configurations for data platform and mathmast roles
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-05-12 10:56:58 +08:00
zhenyus
b7c11d2829 feat: update RBAC configurations and add Jenkinsfile for aml-services
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-05-12 09:56:54 +08:00
Joe
2d7b58dad7 Merge branch 'dev_zhengyang' of ssh.dev.azure.com:v3/freeleaps/freeleaps-ops/freeleaps-ops into dev_zhengyang 2025-05-09 17:53:34 +08:00
Joe
f4df870452 fix: update freeleaps-data-platform 2025-05-09 17:52:53 +08:00
zhenyus
2f7128a51c feat: update namespaces and add RBAC roles for freeleaps data platform and monitoring systems
Signed-off-by: zhenyus <zhenyus@mathmast.com>
2025-05-09 13:10:13 +08:00
Zheng Yang
51cbfbef07 Deleted kafka-monitoring-table.yaml 2025-05-09 02:16:08 +00:00
Joe
a7025081a1 feat: add freeleaps-data-platform 2025-05-09 10:14:16 +08:00
Joe
b2b1fd274f feat: add freeleaps-data-platform 2025-05-09 10:07:00 +08:00