Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge main to 1.x #183

Merged
merged 26 commits into from
Nov 5, 2021
Merged
Show file tree
Hide file tree
Changes from 24 commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
e246c82
Add integTest script to the repo (#94)
peterzhuamazon Jul 9, 2021
7aaf9f8
Removing Usages of Action Get Call and using listeners (#100)
adityaj1107 Jul 22, 2021
1058af0
Enhance ISM template (#105)
bowenlan-amzn Jul 28, 2021
1860f38
Explain response still use old opendistro policy id (#109)
bowenlan-amzn Aug 3, 2021
11da83f
Storing user information as part of the job when security plugin is i…
thalurur Aug 9, 2021
5f6dd66
ISM/Notification channel support (#117)
dbbaughe Aug 13, 2021
c081669
Storing user object in all APIs and enabling filter of response based…
thalurur Aug 17, 2021
ec05789
Upgrade dependencies to 1.1 and build snapshot by default. (#121)
dblock Aug 19, 2021
5c41b04
Security improvements (#126)
thalurur Aug 26, 2021
7897e9a
Removes support for notification plugin (#136)
dbbaughe Aug 31, 2021
9450269
Updating security filtering logic (#137)
thalurur Sep 3, 2021
a8c6cf7
Release note for 1.1.0.0 release. (#139)
bowenlan-amzn Sep 7, 2021
1247284
Uses published daily snapshot dependencies (#141)
dbbaughe Sep 9, 2021
8c48663
License header check (#142)
bowenlan-amzn Sep 10, 2021
dafd3bb
Removed integtest.sh. (#148)
dblock Sep 22, 2021
a5b6359
Adds mavenLocal back to repositories (#158)
dbbaughe Oct 1, 2021
905c16e
Making snapshot name to scripted input in template (#77)
thalurur Oct 1, 2021
780aadf
Fix issues with security changes in rollup runnner (#161)
thalurur Oct 3, 2021
108f625
Updates index management version to 1.2 (#157)
downsrob Oct 5, 2021
11883ae
Adds setting to search all rollup jobs on a target index (#165)
downsrob Oct 6, 2021
6041689
Adds implementation for the delay feature in rollup jobs (#147)
downsrob Oct 13, 2021
b30d3c3
Updates testCompile mockito version, adds AwaitsFix annotation to Met…
downsrob Oct 29, 2021
ab12279
Adds cluster setting to configure index state management jitter (#153)
downsrob Oct 29, 2021
5ad90ff
Allows out of band rollovers on an index without causing ISM to fail …
dbbaughe Nov 2, 2021
ff055dc
Remove policy API on read only indices (#182)
thalurur Nov 3, 2021
7e5e92e
In explain API not showing the total count to all users (#185)
thalurur Nov 5, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/PULL_REQUEST_TEMPLATE.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
*Description of changes:*

*CheckList:*
[ ] Commits are signed per the DCO using --signoff
- [ ] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check [here](https://github.com/opensearch-project/index-management/blob/main/CONTRIBUTING.md#developer-certificate-of-origin).
4 changes: 2 additions & 2 deletions .github/draft-release-notes-config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ replacers:
- search: '##'
replace: '###'

# Organizing the tagged PRs into unified ODFE categories
# Organizing the tagged PRs into unified OpenSearch categories
categories:
- title: 'Breaking changes'
labels:
Expand Down Expand Up @@ -45,4 +45,4 @@ categories:
- 'backwards-compatibility'
- title: 'Refactoring'
labels:
- 'Refactor'
- 'refactor'
42 changes: 1 addition & 41 deletions .github/workflows/multi-node-test-workflow.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,51 +20,11 @@ jobs:
uses: actions/setup-java@v1
with:
java-version: 14
# dependencies: OpenSearch
- name: Checkout OpenSearch
uses: actions/checkout@v2
with:
repository: 'opensearch-project/OpenSearch'
path: OpenSearch
ref: '1.0'
- name: Build OpenSearch
working-directory: ./OpenSearch
run: ./gradlew publishToMavenLocal -Dbuild.snapshot=false
# dependencies: common-utils
- name: Checkout common-utils
uses: actions/checkout@v2
with:
repository: 'opensearch-project/common-utils'
path: common-utils
ref: '1.0'
- name: Build common-utils
working-directory: ./common-utils
run: ./gradlew publishToMavenLocal -Dopensearch.version=1.0.0
# dependencies: job-scheduler
- name: Checkout job-scheduler
uses: actions/checkout@v2
with:
repository: 'opensearch-project/job-scheduler'
path: job-scheduler
ref: '1.0'
- name: Build job-scheduler
working-directory: ./job-scheduler
run: ./gradlew publishToMavenLocal -Dopensearch.version=1.0.0 -Dbuild.snapshot=false
# dependencies: alerting-notification
- name: Checkout alerting
uses: actions/checkout@v2
with:
repository: 'opensearch-project/alerting'
path: alerting
ref: '1.0'
- name: Build alerting
working-directory: ./alerting
run: ./gradlew :alerting-notification:publishToMavenLocal -Dopensearch.version=1.0.0 -Dbuild.snapshot=false
# index-management
- name: Checkout Branch
uses: actions/checkout@v2
- name: Run integration tests with multi node config
run: ./gradlew integTest -PnumNodes=3
run: ./gradlew integTest -PnumNodes=3 -Dopensearch.version=1.2.0-SNAPSHOT
- name: Upload failed logs
uses: actions/upload-artifact@v2
if: failure()
Expand Down
44 changes: 2 additions & 42 deletions .github/workflows/test-and-build-workflow.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,51 +20,11 @@ jobs:
uses: actions/setup-java@v1
with:
java-version: 14
# dependencies: OpenSearch
- name: Checkout OpenSearch
uses: actions/checkout@v2
with:
repository: 'opensearch-project/OpenSearch'
path: OpenSearch
ref: '1.0'
- name: Build OpenSearch
working-directory: ./OpenSearch
run: ./gradlew publishToMavenLocal -Dbuild.snapshot=false
# dependencies: common-utils
- name: Checkout common-utils
uses: actions/checkout@v2
with:
repository: 'opensearch-project/common-utils'
path: common-utils
ref: '1.0'
- name: Build common-utils
working-directory: ./common-utils
run: ./gradlew publishToMavenLocal -Dopensearch.version=1.0.0
# dependencies: job-scheduler
- name: Checkout job-scheduler
uses: actions/checkout@v2
with:
repository: 'opensearch-project/job-scheduler'
path: job-scheduler
ref: '1.0'
- name: Build job-scheduler
working-directory: ./job-scheduler
run: ./gradlew publishToMavenLocal -Dopensearch.version=1.0.0 -Dbuild.snapshot=false
# dependencies: alerting-notification
- name: Checkout alerting
uses: actions/checkout@v2
with:
repository: 'opensearch-project/alerting'
path: alerting
ref: '1.0'
- name: Build alerting
working-directory: ./alerting
run: ./gradlew :alerting-notification:publishToMavenLocal -Dopensearch.version=1.0.0 -Dbuild.snapshot=false
# index-management
# build index management
- name: Checkout Branch
uses: actions/checkout@v2
- name: Build with Gradle
run: ./gradlew build
run: ./gradlew build -Dopensearch.version=1.2.0-SNAPSHOT
- name: Upload failed logs
uses: actions/upload-artifact@v2
if: failure()
Expand Down
7 changes: 5 additions & 2 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,9 +1,12 @@
.gradle/
build/
out/
.idea/
.idea/*
!.idea/copyright
*.ipr
*.iws
.DS_Store
*.log
http
http
.project
.settings
6 changes: 6 additions & 0 deletions .idea/copyright/OpenSearch.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

7 changes: 7 additions & 0 deletions .idea/copyright/profiles_settings.xml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

14 changes: 2 additions & 12 deletions NOTICE
Original file line number Diff line number Diff line change
@@ -1,12 +1,2 @@
OpenSearch
Copyright 2021 OpenSearch Contributors

This product includes software developed by
Elasticsearch (http://www.elastic.co).
Copyright 2009-2018 Elasticsearch

This product includes software developed by The Apache Software
Foundation (http://www.apache.org/).

This product includes software developed by
Joda.org (http://www.joda.org/).
OpenSearch (https://opensearch.org/)
Copyright OpenSearch Contributors
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[![Test and Build Workflow](https://github.com/opensearch-project/index-management/workflows/Test%20and%20Build%20Workflow/badge.svg)](https://github.com/opensearch-project/index-management/actions)
[![codecov](https://codecov.io/gh/opensearch-project/index-management/branch/main/graph/badge.svg)](https://codecov.io/gh/opensearch-project/index-management)
[![Documentation](https://img.shields.io/badge/api-reference-blue.svg)](https://docs-beta.opensearch.org/im-plugin/index/)
[![Documentation](https://img.shields.io/badge/api-reference-blue.svg)](https://opensearch.org/docs/im-plugin/index/)
[![Chat](https://img.shields.io/badge/chat-on%20forums-blue)](https://discuss.opendistrocommunity.dev/c/index-management/)
![PRs welcome!](https://img.shields.io/badge/PRs-welcome!-success)

Expand Down Expand Up @@ -58,7 +58,7 @@ See [developer guide](DEVELOPER_GUIDE.md) and [how to contribute to this project

If you find a bug, or have a feature request, please don't hesitate to open an issue in this repository.

For more information, see [project website](https://opensearch.org/) and [documentation](https://docs-beta.opensearch.org/). If you need help and are unsure where to open an issue, try [forums](https://discuss.opendistrocommunity.dev/).
For more information, see [project website](https://opensearch.org/) and [documentation](https://opensearch.org/docs/). If you need help and are unsure where to open an issue, try [forums](https://discuss.opendistrocommunity.dev/).

## Code of Conduct

Expand All @@ -74,4 +74,4 @@ This project is licensed under the [Apache v2.0 License](./LICENSE)

## Copyright

Copyright 2020-2021 Amazon.com, Inc. or its affiliates. All Rights Reserved.
Copyright OpenSearch Contributors. See [NOTICE](NOTICE) for details.
5 changes: 5 additions & 0 deletions build-tools/coverage.gradle
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
/*
* Copyright OpenSearch Contributors
* SPDX-License-Identifier: Apache-2.0
*/

/*
* Copyright 2019 Amazon.com, Inc. or its affiliates. All Rights Reserved.
*
Expand Down
5 changes: 5 additions & 0 deletions build-tools/pkgbuild.gradle
Original file line number Diff line number Diff line change
@@ -1,3 +1,8 @@
/*
* Copyright OpenSearch Contributors
* SPDX-License-Identifier: Apache-2.0
*/

/*
* Copyright 2019 Amazon.com, Inc. or its affiliates. All Rights Reserved.
*
Expand Down
38 changes: 23 additions & 15 deletions build.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -31,14 +31,20 @@ import java.util.function.Predicate

buildscript {
ext {
opensearch_version = System.getProperty("opensearch.version", "1.0.0")
kotlin_version = System.getProperty("kotlin.version", "1.3.72")
opensearch_version = System.getProperty("opensearch.version", "1.2.0-SNAPSHOT")
// 1.1.0 -> 1.1.0.0, and 1.1.0-SNAPSHOT -> 1.1.0.0-SNAPSHOT
opensearch_build = opensearch_version.replaceAll(/(\.\d)([^\d]*)$/, '$1.0$2')
notification_version = System.getProperty("notification.version", opensearch_build)
common_utils_version = System.getProperty("common_utils.version", opensearch_build)
job_scheduler_version = System.getProperty("job_scheduler_version.version", opensearch_build)
kotlin_version = System.getProperty("kotlin.version", "1.4.0")
}

repositories {
mavenLocal()
mavenCentral()
maven { url "https://plugins.gradle.org/m2/" }
maven { url "https://aws.oss.sonatype.org/content/repositories/snapshots" }
}

dependencies {
Expand Down Expand Up @@ -139,30 +145,35 @@ configurations.testCompile {

ext {
projectSubstitutions = [:]
opensearchVersion = "${version}"
isSnapshot = "true" == System.getProperty("build.snapshot", "true")
licenseFile = rootProject.file('LICENSE')
noticeFile = rootProject.file('NOTICE')
}

group = "org.opensearch"
version = "${opensearchVersion}.0"
allprojects {
group = "org.opensearch"
version = "${opensearch_version}" - "-SNAPSHOT" + ".0"
if (isSnapshot) {
version += "-SNAPSHOT"
}
}

dependencies {
compileOnly "org.opensearch:opensearch:${opensearch_version}"
compileOnly "org.opensearch:opensearch-job-scheduler-spi:1.0.0.0"
compileOnly "org.opensearch:opensearch-job-scheduler-spi:${job_scheduler_version}"
compile "org.jetbrains.kotlin:kotlin-stdlib:${kotlin_version}"
compile "org.jetbrains.kotlin:kotlin-stdlib-common:${kotlin_version}"
compile 'org.jetbrains.kotlinx:kotlinx-coroutines-core:1.3.7'
compile "org.jetbrains.kotlin:kotlin-stdlib-jdk8:${kotlin_version}"
compile 'org.jetbrains.kotlinx:kotlinx-coroutines-core:1.3.9'
compile "org.jetbrains:annotations:13.0"
compile "org.opensearch:notification:1.0.0.0"
compile "org.opensearch:common-utils:1.0.0.0"
compile "org.opensearch:notification:${notification_version}"
compile "org.opensearch:common-utils:${common_utils_version}"
compile "com.github.seancfoley:ipaddress:5.3.3"

testCompile "org.opensearch.test:framework:${opensearch_version}"
testCompile "org.jetbrains.kotlin:kotlin-test:${kotlin_version}"
testImplementation "com.nhaarman.mockitokotlin2:mockito-kotlin:2.2.0"
testCompile "org.mockito:mockito-core:2.23.0"
testCompile "org.mockito:mockito-core:3.12.4"

add("ktlint", "com.pinterest:ktlint:0.41.0") {
attributes {
Expand All @@ -173,10 +184,7 @@ dependencies {

repositories {
mavenLocal()
}

if (isSnapshot) {
version += "-SNAPSHOT"
maven { url "https://aws.oss.sonatype.org/content/repositories/snapshots" }
}

plugins.withId('java') {
Expand All @@ -186,7 +194,6 @@ plugins.withId('java') {
plugins.withId('org.jetbrains.kotlin.jvm') {
compileKotlin.kotlinOptions.jvmTarget = compileTestKotlin.kotlinOptions.jvmTarget = "1.8"
compileKotlin.dependsOn ktlint

}

javadoc.enabled = false // turn off javadoc as it barfs on Kotlin code
Expand Down Expand Up @@ -261,6 +268,7 @@ testClusters.integTest {
File getAsFile() { fileTree("src/test/resources/job-scheduler").getSingleFile() }
}
}))

if (securityEnabled) {
plugin(provider({
new RegularFile() {
Expand Down
2 changes: 1 addition & 1 deletion docs/rfc.md
Original file line number Diff line number Diff line change
Expand Up @@ -113,4 +113,4 @@ After building Index State Management API, we will build an administrative panel

## Providing Feedback

If you have comments or feedback on our plans for Index Management, please comment on [the RFC Github issue](../../issues/1) in this project to discuss.
If you have comments or feedback on our plans for Index Management, please comment on [the RFC Github issue](https://github.com/opendistro-for-elasticsearch/index-management/issues/1) in this project to discuss.
26 changes: 0 additions & 26 deletions gradle.properties

This file was deleted.

23 changes: 23 additions & 0 deletions release-notes/opensearch-index-management.release-notes-1.1.0.0.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,23 @@
## Version 1.1.0.0 2021-09-03

Compatible with OpenSearch 1.1.0

### Infrastructure

* Upgrade dependencies to 1.1 and build snapshot by default. ([#121](https://github.com/opensearch-project/index-management/pull/121))

### Features

* Storing user information as part of the job when security plugin is installed ([#113](https://github.com/opensearch-project/index-management/pull/113))
* Storing user object in all APIs and enabling filter of response based on user ([#115](https://github.com/opensearch-project/index-management/pull/115))
* Security improvements ([#126](https://github.com/opensearch-project/index-management/pull/126))
* Updating security filtering logic ([#137](https://github.com/opensearch-project/index-management/pull/137))

### Enhancements

* Enhance ISM template ([#105](https://github.com/opensearch-project/index-management/pull/105))

### Bug Fixes

* Removing Usages of Action Get Call and using listeners ([#100](https://github.com/opensearch-project/index-management/pull/100))
* Explain response still use old opendistro policy id ([#109](https://github.com/opensearch-project/index-management/pull/109))
Loading