All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog and this project adheres to Semantic Versioning.
- Added new variable
beekeeper_db_external_hostname
to support external DB host.
- Kubernetes variables to adjust number replicas on deployments.
- Added datadog annotations to send metrics from
scheduler-apiary
,metadata-cleanup
,path-cleanup
to DD.
- Add
copy_tags_to_snapshot
to aws_rds_cluster.
- Change kiam auth method to irsa for metadata cleanup, path cleanup and scheduler apiary
- Change provider version for kubernetes to 2.13.0
- Updating
beekeeper_slack_notifier
Lambda function inlambda.tf
that is currently using the deprecated Python 3.7 runtime to the Python 3.9 runtime
- Updated hosted runner from the deprecated
ubuntu-18.04
toubuntu-22.04
to fix failing GitHub Actions
- Added
HADOOP_USER_NAME
environment variable and set it tobeekeeper
- Upgdate k8s API to work with 2.x version:
kubernetes_deployment
tokubernetes_deployment_v1
kubernetes_ingress
tokubernetes_ingress_v1
- Update terrafrom
map
function totomap
(map
function has been deprecated in0.12
version).
- Increase k8s provider version to
~>2.7.0
(was~>1.0.0
). Fixes issue with K8S upgrade and error: 'Failed to create Ingress'.
- Added variables
db_apply_immediately
(defaultfalse
) anddb_performance_insights_enabled
(defaulttrue
). - Minimum required version for
aws
provider set to~> 4.0
.
- Increased the required version of terraform to
>= 0.12.31
(was> 0.12.0
).
- Changed the
rds_storage_type
fromgp2
togp3
. - Increased the
rds_allocated_storage
from 10 to 20 GB.
- Changed the service namespace from
default
tobeekeeper
inbeekeeper-metadata-cleanup
,beekeeper-path-cleanup
andbeekeeper-scheduler-apiary
. - Changed some variables from type
string
tonumber
. - Fixed the
beekeeper
ingress so that thek8s_ingress_enabled
variable works.
- Terraform files for
beekeeper-api
module.
- Pin K8S provider version to
1.x
for compatibility with other Apiary components deployed in the same Terraform state file. - Don't use instance alias as part of default DB name since all the Flyway scripts expect "beekeeper" as the db name.
- Removed variable
DB_PASSWORD_STRATEGY
. - Securely injecting
db_password_key
in k8s and ecs instead of pulling these credentials from AWS Secret Manager in Beekeeper.
- Added variable
docker_registry_secret_name
to pull docker images from a private registry.
- Separated
dry_run_enabled
variable intopath_cleanup_dry_run_enabled
andmetadata_cleanup_dry_run_enabled
so one module can be used in dry run mode without affecting the other.
- Kubernetes deployment options for new Metadata Cleanup module.
- Renamed
Cleanup
toPath Cleanup
, andPath Scheduler
toScheduler Apiary
to match name changes in Beekeeper.
- Fix multi instance deployment resource names.
- Default blank value for
k8s_kiam_role_arn
.
- Refactoring graphite configuration so that it can be switched off.
- Add annotations to Kubernetes deployments to support Prometheus scraper.
- Add support for Kubernetes by specifying
var.instance_type = "k8s"
. - Add Kubernetes deployment options for Cleanup and Path Scheduler.
- Add KIAM role creation for k8s pods.
- Refactored to remove
main
andlambda
modules. - Updated Terraform syntax to be compliant with Terraform 0.12 and not throw warnings.
- Run
terraform fmt
on all code to enforce style.
- Updating S3 IAM policy name to be region specific.
- First version of Beekeeper terraform module