-
Notifications
You must be signed in to change notification settings - Fork 9.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
core: "diffs didn't match during apply" error message. #4965
core: "diffs didn't match during apply" error message. #4965
Conversation
Hi @dharrisio! Thanks for opening this pull request and for the research that has gone into it. It sounds like a good explanation for this range of bugs. I'm going to pull this now and see what I can find and hopefully merge. |
This certainly fixes several reproductions of this problem. I'll go ahead and merge it and then work my way through the open issues to determine which can be closed. Thanks @dharrisio! |
…apply core: "diffs didn't match during apply" error message.
@jen20 Thanks! |
Coming back to this to try to add some test coverage prior to release - prior to the patch being applied the following configuration is a minimal reproduction: provider "aws" {
region = "us-east-1"
}
resource "aws_instance" "default" {
ami = "ami-fbb9c991"
instance_type = "t2.nano"
tags {
Name = "Repro 4965"
}
lifecycle {
ignore_changes = ["tags"]
}
} |
Even better in lieu of implementing a test provider here, this also replicates it: resource "template_file" "test" {
template = "The template text"
vars {
key1 = "value1"
}
lifecycle {
ignore_changes = ["vars"]
}
} |
This test presents itself in an awkward manner as part of the AWS test suite rather than the core test suite - this is because you cannot use real providers in context tests because of circular references, and simplistic test providers in that package do not demonstrate the issue. In the interests of getting this fix in quickly and still having regression coverage for it, it was agreed to include the change here instead. Running the test TestAccAWSVPC_coreMismatchedDiffs without the changes in d95ab75 applied leads to the following output: ``` $ make testacc TEST=./builtin/providers/aws TESTARGS="-run TestAccAWSVPC_coreMismatchedDiffs" ==> Checking that code complies with gofmt requirements... /Users/James/Code/go/bin/stringer GO15VENDOREXPERIMENT=1 go generate $(GO15VENDOREXPERIMENT=1 go list ./... | grep -v /vendor/) TF_ACC=1 GO15VENDOREXPERIMENT=1 go test ./builtin/providers/aws -v -run TestAccAWSVPC_coreMismatchedDiffs -timeout 120m === RUN TestAccAWSVPC_coreMismatchedDiffs --- FAIL: TestAccAWSVPC_coreMismatchedDiffs (2.26s) testing.go:148: Step 0 error: Error applying: 1 error(s) occurred: * aws_vpc.test: diffs didn't match during apply. This is a bug with Terraform and should be reported. FAIL exit status 1 FAIL github.com/hashicorp/terraform/builtin/providers/aws 2.281s make: *** [testacc] Error 1 ``` Applying the changes in d95ab75 (pull request GH-4965) yields the following result when running the test: ``` $ make testacc TEST=./builtin/providers/aws TESTARGS="-run TestAccAWSVPC_coreMismatchedDiffs" ==> Checking that code complies with gofmt requirements... /Users/James/Code/go/bin/stringer GO15VENDOREXPERIMENT=1 go generate $(GO15VENDOREXPERIMENT=1 go list ./... | grep -v /vendor/) TF_ACC=1 GO15VENDOREXPERIMENT=1 go test ./builtin/providers/aws -v -run TestAccAWSVPC_coreMismatchedDiffs -timeout 120m === RUN TestAccAWSVPC_coreMismatchedDiffs --- PASS: TestAccAWSVPC_coreMismatchedDiffs (15.17s) PASS ok github.com/hashicorp/terraform/builtin/providers/aws 15.183s ``` The test has a rather misleading name ("AWS") such that it is actually run as part of the nightly acceptance testing. The VPC resource is quick and free to create, hence the selection.
See #5227 for tests covering this. |
core: Test fix for mismatched diffs from GH-4965
This test presents itself in an awkward manner as part of the AWS test suite rather than the core test suite - this is because you cannot use real providers in context tests because of circular references, and simplistic test providers in that package do not demonstrate the issue. In the interests of getting this fix in quickly and still having regression coverage for it, it was agreed to include the change here instead. Running the test TestAccAWSVPC_coreMismatchedDiffs without the changes in d95ab75 applied leads to the following output: ``` $ make testacc TEST=./builtin/providers/aws TESTARGS="-run TestAccAWSVPC_coreMismatchedDiffs" ==> Checking that code complies with gofmt requirements... /Users/James/Code/go/bin/stringer GO15VENDOREXPERIMENT=1 go generate $(GO15VENDOREXPERIMENT=1 go list ./... | grep -v /vendor/) TF_ACC=1 GO15VENDOREXPERIMENT=1 go test ./builtin/providers/aws -v -run TestAccAWSVPC_coreMismatchedDiffs -timeout 120m === RUN TestAccAWSVPC_coreMismatchedDiffs --- FAIL: TestAccAWSVPC_coreMismatchedDiffs (2.26s) testing.go:148: Step 0 error: Error applying: 1 error(s) occurred: * aws_vpc.test: diffs didn't match during apply. This is a bug with Terraform and should be reported. FAIL exit status 1 FAIL github.com/hashicorp/terraform/builtin/providers/aws 2.281s make: *** [testacc] Error 1 ``` Applying the changes in d95ab75 (pull request hashicorpGH-4965) yields the following result when running the test: ``` $ make testacc TEST=./builtin/providers/aws TESTARGS="-run TestAccAWSVPC_coreMismatchedDiffs" ==> Checking that code complies with gofmt requirements... /Users/James/Code/go/bin/stringer GO15VENDOREXPERIMENT=1 go generate $(GO15VENDOREXPERIMENT=1 go list ./... | grep -v /vendor/) TF_ACC=1 GO15VENDOREXPERIMENT=1 go test ./builtin/providers/aws -v -run TestAccAWSVPC_coreMismatchedDiffs -timeout 120m === RUN TestAccAWSVPC_coreMismatchedDiffs --- PASS: TestAccAWSVPC_coreMismatchedDiffs (15.17s) PASS ok github.com/hashicorp/terraform/builtin/providers/aws 15.183s ``` The test has a rather misleading name ("AWS") such that it is actually run as part of the nightly acceptance testing. The VPC resource is quick and free to create, hence the selection.
I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues. If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further. |
Fix
ignore_changes
issue with error messagediffs didn't match during apply
.This error shows up when using
ignore_changes
for attributes that may be modified outside of Terraform. As an example seeversion_label
in #3871.I also checked #4912 and it seemed to fix the issue there too.
Other issues I haven't checked into but look like they may be effected too.
#4819
#4790
#4696
#4045
#3869
#3739
#3738
#3566
#4859 (not a fix, but maybe related)
I think the issue is that only the plan diff was using EvalIgnoreChanges. Because this was not occurring in the apply step, the diffs were not equal when
ignore_changes
was being used.Sample Terraform document with to reproduce error message.