How can we cover unit testing for datastore? #2

jgeewax · 2014-01-29T19:28:46Z

Right now, the only way to develop this is by hitting the live Cloud Datastore API. Is there a way we can use these API calls in unit tests without mocking?

Can we have a "local datastore" server that understands the API and makes it easy for local development?

proppy · 2014-01-29T21:40:18Z

You could use gcd: the local development server, see:
https://developers.google.com/datastore/docs/tools/devserver

jgeewax · 2014-01-30T20:58:34Z

That looks good for local development. It runs on Java right ?

I wonder how difficult it would be to patch in the stubs from AppEngine's dev_appserver.py so that i can use something akin to ext.testbed to unittest locally (ie, without hitting the wire, stay all in Python).

proppy · 2014-01-30T21:10:18Z

That looks good for local development. It runs on Java right ?

Yes, it is embedding the App Engine Java development server and running the same servlet that is running in production.

I wonder how difficult it would be to patch in the stubs from AppEngine's dev_appserver.py so that i can use something akin to ext.testbed to unittest locally (ie, without hitting the wire, stay all in Python).

You would have to handle the datastore_v1.proto to datastore_v4 convertion somehow.

Keep in mind that datastore_v4 private interface is not really documented and also subject to change: datastore_v1 is the public versionned interface.

jgeewax · 2014-01-30T21:13:00Z

Yikes. Well I realllly don't want to force people to spin up a local server in order to run unit tests...

We'll have to come up with a way to stub this out.

tseaver · 2014-09-23T13:39:51Z

#130 adds 100% unit test coverage for modules in gcloud, gcloud.datastore. I would call its strategy "stubbing" (testcases explicitly stub out the http or connection objects) rather than "mocking" (using a general-purpose utilitiy like 'mock').

tseaver · 2014-10-17T16:47:06Z

#106 exists to cover the deficiencies of testing with stubbed / mocked backends.

* Defend against back-end returning instance configs for disallowed regions. * Additional system tests for 'Snapshot.read': - Read single key. - Read multiple keys. - Read open-closed ranges. - Read open-open ranges. - Read closed-open ranges. - Read closed-closed ranges. - Read timestamp. - Min read timestamp. - Max staleness. - Exact staleness. - Strong. * Additional system tests for 'Snapshot.execute_sql': - Query returning 'ARRAY<STRUCT>'. - Bind INT64 parameter to null.

…eapis#2

add GB timezone

update janscas changes

* chore: update documentation link in README * 🦉 Updates from OwlBot See https://github.com/googleapis/repo-automation-bots/blob/master/packages/owl-bot/README.md * coverage * 🦉 Updates from OwlBot See https://github.com/googleapis/repo-automation-bots/blob/master/packages/owl-bot/README.md Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>

🤖 I have created a release \*beep\* \*boop\* --- ## 0.1.0 (2021-03-15) ### Features * generate v1alpha ([2c025f8](https://www.github.com/googleapis/python-dataproc-metastore/commit/2c025f80c7791ef864ce2bf655429e1ecf40d288)) * generate v1beta ([942ddcd](https://www.github.com/googleapis/python-dataproc-metastore/commit/942ddcd6ddd18bd6d79cf2c57685a743ea35a376)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).

🤖 I have created a release \*beep\* \*boop\* --- ### [0.1.1](https://www.github.com/googleapis/python-notebooks/compare/v0.1.0...v0.1.1) (2020-08-06) ### Bug Fixes * fix package name ([#2](https://www.github.com/googleapis/python-notebooks/issues/2)) ([ae80dcf](https://www.github.com/googleapis/python-notebooks/commit/ae80dcffc544a31096e9f076e9538985c1b3a44f)) --- This PR was generated with [Release Please](https://github.com/googleapis/release-please).

Source-Author: Bu Sun Kim <8822365+busunkim96@users.noreply.github.com> Source-Date: Mon Jan 11 09:43:06 2021 -0700 Source-Repo: googleapis/synthtool Source-Sha: 16ec872dd898d7de6e1822badfac32484b5d9031 Source-Link: googleapis/synthtool@16ec872

Fixes #2 🦕 This PR adds the auto generated `v3` client for Resource Manager and changes the release status from `alpha` to `beta`. This is a significant change from the previous version `v1beta1`, as this is the first version of an auto generated client. chore(release_status): upgrade release status from alpha to beta fix: remove v1beta1 chore(deps): require python 3.6+

* chore: add SECURITY.md * chore: use a valid post processor image * 🦉 Updates from OwlBot Co-authored-by: google-cloud-policy-bot[bot] <80869356+google-cloud-policy-bot[bot]@users.noreply.github.com> Co-authored-by: Anthonios Partheniou <partheniou@google.com> Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>

* chore(main): release 0.1.0 * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * remove python 3.6 sample configs * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * fix(deps): require google-api-core >= 2.8.0 Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com> Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com> Co-authored-by: Anthonios Partheniou <partheniou@google.com>

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>

* chore(main): release 0.1.0 * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * use latest post processor image * 🦉 Updates from OwlBot post-processor See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md * fix(deps): require google-api-core >= 2.8.0 * remove python 3.6 sample configs Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com> Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com> Co-authored-by: Anthonios Partheniou <partheniou@google.com>

* chore(main): release 0.1.0 * add commit to trigger gh actions * add commit to trigger gh actions Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com> Co-authored-by: Anthonios Partheniou <partheniou@google.com>

- [ ] Regenerate this pull request now. chore: fix snippet region tag format chore: fix docstring code block formatting PiperOrigin-RevId: 430730865 Source-Link: googleapis/googleapis@ea58002 Source-Link: googleapis/googleapis-gen@ca893ff Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiY2E4OTNmZjhhZjI1ZmM3ZmUwMDFkZTE0MDVhNTE3ZDgwNDQ2ZWNjYSJ9

* updated CHANGELOG.md [ci skip] * updated setup.cfg [ci skip] * updated setup.py [ci skip] Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>

* chore: add split repo templates * test: increase coverage values

Fixes #2 🦕 Release-As: 1.0.0

Fix the development status classifier to be consistent with 'alpha' in the README. Also fixes some docs related kokoro configs. The `docs/docs.cfg` job that is triggered by successfulrelease jobs was failing because `NOX_SESSION` was in the required env vars list.

PiperOrigin-RevId: 381356178 Source-Link: googleapis/googleapis@6fa6c00 Source-Link: googleapis/googleapis-gen@ba89d92

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com> Co-authored-by: Anthonios Partheniou <partheniou@google.com>

jgeewax mentioned this issue Feb 10, 2014

How can we cover unit testing for the library? jgeewax/gclouddatastore#8

Open

jgeewax added the testing label May 1, 2014

tseaver closed this as completed Oct 17, 2014

jgeewax modified the milestone: Datastore Stable Jan 30, 2015

twumdjin mentioned this issue Feb 13, 2015

Using gcloud datastore with a local devserver #639

Closed

tseaver mentioned this issue Feb 16, 2015

#15: Add storage.batch.Batch #654

Merged

tseaver mentioned this issue May 6, 2015

Explore going the route of using Clients ? #861

Closed

dhermes mentioned this issue Jul 1, 2015

Move implicit majyk inside 'Client.__init__'. #956

Merged

daspecster mentioned this issue Jun 23, 2016

set correct project when using from_service_account_json #1883

Closed

joeholley mentioned this issue Sep 23, 2016

Inconsistent subscription behavior with deleted topic #2413

Closed

majuscule mentioned this issue Nov 30, 2016

How to test gcloud applications #1822

Closed

tseaver mentioned this issue Dec 28, 2016

Adding support for Standard SQL views #2898

Closed

Edo-A mentioned this issue Nov 15, 2017

PubSub: Quickstart examples for Pub/Sub subscriber not working #4394

Closed

davidebelloni added a commit to davidebelloni/google-cloud-python that referenced this issue Dec 7, 2017

Storage: sourceGeneration in copy_blob googleapis#4533 - BugFix googl…

2107fce

…eapis#2

mcdonc mentioned this issue Nov 2, 2018

Firestore: implement set such that it passes conformance testing #6307

Closed

urshala pushed a commit to urshala/google-cloud-python that referenced this issue Jan 17, 2020

Merge pull request googleapis#2 from PhoenixAlx/master

5dce8f8

add GB timezone

urshala pushed a commit to urshala/google-cloud-python that referenced this issue Jan 17, 2020

Merge pull request googleapis#2 from O365/master

1e0da3b

update janscas changes

bisandip mentioned this issue Oct 16, 2020

Uncaught exceptions within the streaming pull code. #7709

Closed

JustinBeckwith assigned tseaver Feb 1, 2021

parthea added a commit that referenced this issue Jun 4, 2023

docs: fix typo in docs/index.rst (#2)

c0fdf43

parthea pushed a commit that referenced this issue Jun 4, 2023

chore: release 0.1.0 (#2)

e4ae845

parthea pushed a commit that referenced this issue Jun 4, 2023

fix: fix package name (#2)

3fc081a

parthea pushed a commit that referenced this issue Jun 4, 2023

chore: release 0.3.0 (#2)

e67be01

parthea pushed a commit that referenced this issue Jun 4, 2023

fix: correct name in setup.py (#2)

a6a7338

parthea pushed a commit that referenced this issue Jun 4, 2023

chore: release 0.1.0 (#2)

9841ed5

parthea pushed a commit that referenced this issue Jun 4, 2023

chore: release 0.6.0 (#2)

8860315

parthea pushed a commit that referenced this issue Jun 4, 2023

chore: release 0.4.0 (#2)

3a7e1d1

parthea pushed a commit that referenced this issue Jun 4, 2023

chore: release 0.4.0 (#2)

127662c

parthea pushed a commit that referenced this issue Aug 15, 2023

chore: release 0.1.0 (#2)

4a9d5a6

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>

parthea pushed a commit that referenced this issue Sep 22, 2023

chore: release 0.1.0 (#2)

41aaf0b

* updated CHANGELOG.md [ci skip] * updated setup.cfg [ci skip] * updated setup.py [ci skip] Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>

parthea pushed a commit that referenced this issue Sep 22, 2023

fix: fix documentation links (#2)

4ffd8e8

parthea pushed a commit that referenced this issue Sep 22, 2023

chore: add split repo templates (#2)

0902376

* chore: add split repo templates * test: increase coverage values

parthea added a commit that referenced this issue Oct 21, 2023

chore: add constraints file (#2)

b57a7c0

parthea added a commit that referenced this issue Oct 21, 2023

feat: bump release level to production/stable (#4)

aceed6f

Fixes #2 🦕 Release-As: 1.0.0

parthea pushed a commit that referenced this issue Oct 21, 2023

chore: prepare v1beta3 (#2)

2642721

PiperOrigin-RevId: 381356178 Source-Link: googleapis/googleapis@6fa6c00 Source-Link: googleapis/googleapis-gen@ba89d92

parthea pushed a commit that referenced this issue Oct 21, 2023

chore: release 2.0.1 (#2)

6713bae

parthea added a commit that referenced this issue Oct 22, 2023

chore(main): release 0.1.0 (#2)

254ca64

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com> Co-authored-by: Anthonios Partheniou <partheniou@google.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

How can we cover unit testing for datastore? #2

How can we cover unit testing for datastore? #2

jgeewax commented Jan 29, 2014

proppy commented Jan 29, 2014

jgeewax commented Jan 30, 2014

proppy commented Jan 30, 2014

jgeewax commented Jan 30, 2014

tseaver commented Sep 23, 2014

tseaver commented Oct 17, 2014

How can we cover unit testing for datastore? #2

How can we cover unit testing for datastore? #2

Comments

jgeewax commented Jan 29, 2014

proppy commented Jan 29, 2014

jgeewax commented Jan 30, 2014

proppy commented Jan 30, 2014

jgeewax commented Jan 30, 2014

tseaver commented Sep 23, 2014

tseaver commented Oct 17, 2014