Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ElasticSearch] UltraWarm Elasticsearch #6462

Closed
9tontruck opened this issue Feb 26, 2020 · 8 comments · Fixed by #12265
Closed

[ElasticSearch] UltraWarm Elasticsearch #6462

9tontruck opened this issue Feb 26, 2020 · 8 comments · Fixed by #12265
Assignees
@iliapolo
Labels
@aws-cdk/aws-elasticsearch Related to Amazon Elasticsearch Service effort/small Small work item – less than a day of effort feature-request A feature should be added or improved. good first issue Related to contributions. See CONTRIBUTING.md p2

Comments

@9tontruck
Copy link

I would like to make a feature request for UltraWarm Elasticsearch features.
AWS UltraWarm Elasticsearch:
https://docs.aws.amazon.com/elasticsearch-service/latest/developerguide/ultrawarm.html

The biggest benefit of UltraWarm is about 90% reduced storage cost by storing data in S3 instead of SSD.

Use Case

We are building a project that involves indexing visual features of more than 100 million images and we planned to use an Elasticsearch. Because the size of data we need to index is extremely huge, the expected resource cost is also really high. By using UltraWarm, we are expecting about 90% of storage cost drop.

Proposed Solution

When Elasticsearch is being created,
ElasticsearchClusterConfigProperty would need to accept following parameters

  1. warmEnabled: true/false. Enabling UltraWarm elasticsearch
  2. warmCount: int. Number of instances
  3. warmType: String. Type of instance. eg. ultrawarm1.medium.elasticsearch
@9tontruck 9tontruck added feature-request A feature should be added or improved. needs-triage This issue or PR still needs to be triaged. labels Feb 26, 2020
@SomayaB SomayaB added the @aws-cdk/aws-elasticsearch Related to Amazon Elasticsearch Service label Feb 27, 2020
@iliapolo iliapolo added the needs-cfn This issue is waiting on changes to CloudFormation before it can be addressed. label Mar 16, 2020
@iliapolo
Copy link
Contributor

Hi @9tontruck - Thanks for reporting this!

Unfortunately, this feature is not yet supported by CloudFormation.

https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticsearch-domain-elasticsearchclusterconfig.html

I'm marking this request as needs-cfn and once they add support we can start pushing this forward.

@9tontruck
Copy link
Author

Hi @9tontruck - Thanks for reporting this!

Unfortunately, this feature is not yet supported by CloudFormation.

https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticsearch-domain-elasticsearchclusterconfig.html

I'm marking this request as needs-cfn and once they add support we can start pushing this forward.

Thank you!

@iliapolo iliapolo added the effort/small Small work item – less than a day of effort label Apr 12, 2020
@SomayaB SomayaB removed the needs-triage This issue or PR still needs to be triaged. label May 19, 2020
@9tontruck
Copy link
Author

Any updates on this?

@iliapolo
Copy link
Contributor

@9tontruck It still is not available in CloudFormation unfortunately.

I encourage you to open a feature request for CloudFormation as well.

@erik-sab
Copy link

Reference to CloudFormation feature request: aws-cloudformation/cloudformation-coverage-roadmap#283

@heikkis
Copy link

heikkis commented Dec 1, 2020

Support for CF has been published: https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-elasticsearch-domain-elasticsearchclusterconfig.html

@iliapolo iliapolo added p2 good first issue Related to contributions. See CONTRIBUTING.md and removed needs-cfn This issue is waiting on changes to CloudFormation before it can be addressed. labels Dec 1, 2020
@jumi-dev
Copy link
Contributor

I will implement the support for UltraWarm instances and create a pull request.

@jumi-dev jumi-dev mentioned this issue Dec 29, 2020
Merged
@mergify mergify bot closed this as completed in #12265 Jan 17, 2021
mergify bot pushed a commit that referenced this issue Jan 17, 2021
@jumi-dev
feat(elasticsearch): UltraWarm nodes (#12265)
3a9056d 
ElasticSearch-support for UltraWarm nodes including validations for necessary pre-requirements.

Closes #6462.

----

*By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license*
@github-actions
Copy link

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.

mohanrajendran pushed a commit to mohanrajendran/aws-cdk that referenced this issue Jan 24, 2021
@jumi-dev
feat(elasticsearch): UltraWarm nodes (aws#12265)
dc8248a 
ElasticSearch-support for UltraWarm nodes including validations for necessary pre-requirements.

Closes aws#6462.

----

*By submitting this pull request, I confirm that my contribution is made under the terms of the Apache-2.0 license*
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@iliapolo iliapolo

Labels
@aws-cdk/aws-elasticsearch Related to Amazon Elasticsearch Service effort/small Small work item – less than a day of effort feature-request A feature should be added or improved. good first issue Related to contributions. See CONTRIBUTING.md p2
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat(elasticsearch): UltraWarm nodes jumi-dev/aws-cdk
6 participants
@heikkis @iliapolo @9tontruck @SomayaB @erik-sab @jumi-dev