Repo refactoring (#5345)

* Split storage and storage-compat (#5271)

* separate storage-compat from storage

* commit

* fix tests

* wat?

* build storage-compat

* save

* fixing some compat tests

* format

* update import path

* format

* get compat tests to work

* format

* update package json

* cleanup

* format

* address comments

* Update packages/storage-compat/test/unit/service.test.ts

Co-authored-by: Christina Holland <chholland@google.com>

* add missing dev dep

* Update packages/storage-compat/package.json

* Update packages/storage-compat/package.json

* Update deps after v8 release

* update compat version

* Split database and database-compat (#5276)

* compile database

* pass database tests

* compile and test database-compat

* pass all tests

* prettier

* cleanup

* fix lint

* address comments

* what is going on with ci

* use correct case in import path

* uppercase

* rename

* fix component name

* Repo refactoring for v9 (#5325)

* rename folders

* rename folders

* migrate app and app-compat

* migrate installations and analytics

* migrate app check

* migrate auth

* migrate functions

* migrate messaging

* migrate performance

* migrate remoteconfig

* remove v8 code

* update versions

* migrate firebase

* fix merge issues

* save

* fix firebase builds

* update changeset config

* update build scripts

* update release script

* fix functions typings

* remove redundant typings

* update path

* treat external dependencies correctly

* fix lint

* remove firestore-compat references

* fix build issues

* update build scripts

* update pkg json

* fix test

* fix some tests

* fix some tests

* fix integration tests

* fixes

* fix dep

* update ci tests

* resolve todos

* remove exp references

* docgen build

* export FirebaseError (#5349)

* firebase packaging update (#5348)

* Fei v9 main firestore (#5319)

* compile firestore

* update typings path

* compile firestore compat

* lint compat

* make test work

* get most tests work

* build

* remove special paths

* update firestore-compat pkg json

* fix merge issues

* Simplify bundles

* Prettier

* Fix Bundle compile

* Fix build

* address comments

* console build

* Fix all tests

* Prettier

* fix merge issues

* fix typo

* update paths

* app-exp

* fix lint

* correct path

* fix

* fix compat lint

* fix firestore integration

* fix workflow

* update dep

* Always block on Auth (#5340)

* Always block on Auth

* Don't block on token if already recevied

* fix lint

* build firestore

* remove memory only tests

* fix firebase integration tests

* enable more build and tests

* add firestore-compat to firebase dep

* fix auth compat class

* enable auth test

* auth package doc

* Update API reports

Co-authored-by: Sebastian Schmidt <mrschmidt@google.com>
Co-authored-by: Feiyang1 <Feiyang1@users.noreply.github.com>

* rebasing

* Create registerMessagingCompat.ts

* Add changeset for v9 (#5350)

* add changeset

* publish messaging interop

* add firestore bumps

* update changeset

* Revert "Create registerMessagingCompat.ts"

This reverts commit 0b95a51.

* Revert "rebasing"

This reverts commit a8bf697.

* Update index.d.ts (#5355)

* Fix Context Check in `Messaging-Compat` (#5353)

* Add Rules Unit Testing v2 skeleton for v9 release (#5352)

* Reset package for next major version.

* Switch emulator script to node-fetch.

* Migrate the other request call to fetch.

* Update packages/rules-unit-testing/package.json

Co-authored-by: Feiyang <feiyangc@google.com>

* Create stale-ducks-live.md

* Revert version change.

Co-authored-by: Feiyang <feiyangc@google.com>

* fix import path (#5356)

* Add new types and function stubs for RUT vNext. (#5316)

* Add new types and function stubs.

* Fix types for testEnv.emulators.

* Add util functions.

* Add withFunctionTriggersDisabled overloads.

* Improve typing for EmulatorConfig.

* Fix tests.

* Rename test_environment.ts to initialize.ts.

* Add a dummy test to make CI pass.

* Implement emulators discovery in RUTv2. (#5334)

* Add new types and function stubs.

* Fix types for testEnv.emulators.

* Add util functions.

* Add withFunctionTriggersDisabled overloads.

* Improve typing for EmulatorConfig.

* Fix tests.

* Rename test_environment.ts to initialize.ts.

* Add a dummy test to make CI pass.

* Implement emulators discovery.

* Use URL object from global.

* Fix unreachable  error code.

* Implement most of RUTv2 features. (#5343)

* Implement most of RUTv2 features.

* Switch to compat instances.

* Remove legacy code.

* Use public typings for release (#5358)

* use public typings for storage

* use public typings for database

* Implement rest of RUTv2 features. (#5360)

* Implement loading rules and withFunctionTriggersDisabled.

* Implement clearFirestore and storage.

* Add missing await.

* Add default bucketUrl.

* Use alternative method to clear bucket.

* Use default param (review feedback).

* Storage typing updates (#5359)

* rename to StorageError

* more type safety

* Update API reports

* update api report

Co-authored-by: Feiyang1 <Feiyang1@users.noreply.github.com>

* correct component name

* fix installtions-compat typing

* remove rules-unit-testing from ignore list

* reenable things

* support mjs files

* correct matching pattern

* transform only @firebase/util

* use public types for database doc

* transform all but compat packages

Co-authored-by: Sebastian Schmidt <mrschmidt@google.com>
Co-authored-by: Feiyang1 <Feiyang1@users.noreply.github.com>
Co-authored-by: kai <zwu52@uw.edu>
Co-authored-by: Yuchen Shi <yuchenshi@google.com>
Co-authored-by: Kai Wu <zwu52@users.noreply.github.com>

.changeset/config.json

@@ -15,25 +15,6 @@
     "firebase-messaging-integration-test",
     "firebase-compat-interop-test",
     "firebase-compat-typings-test",
-    "@firebase/app-compat",
-    "@firebase/app-exp",
-    "@firebase/app-check-compat",
-    "@firebase/app-check-exp",
-    "@firebase/analytics-compat",
-    "@firebase/analytics-exp",
-    "@firebase/auth-exp",
-    "@firebase/auth-compat",
-    "@firebase/functions-compat",
-    "@firebase/functions-exp",
-    "@firebase/installations-exp",
-    "@firebase/installations-compat",
-    "@firebase/messaging-exp",
-    "@firebase/messaging-compat",
-    "@firebase/performance-exp",
-    "@firebase/performance-compat",
-    "@firebase/remote-config-exp",
-    "@firebase/remote-config-compat",
-    "firebase-exp",
     "@firebase/changelog-generator",
     "firebase-size-analysis"
   ],

.changeset/stale-ducks-live.md

@@ -0,0 +1,5 @@
+---
+"@firebase/rules-unit-testing": major
+---
+
+BREAKING: Implement Rules Unit Testing v2 with new design and APIs.

.changeset/tame-olives-compete.md

@@ -0,0 +1,43 @@
+---
+'firebase': major
+'@firebase/firestore': major
+'@firebase/rules-unit-testing': major
+'@firebase/firestore-compat': minor
+'@firebase/firestore-types': minor
+'@firebase/analytics': minor
+'@firebase/analytics-compat': minor
+'@firebase/analytics-types': minor
+'@firebase/app': minor
+'@firebase/app-check': minor
+'@firebase/app-check-compat': minor
+'@firebase/app-check-types': minor
+'@firebase/app-compat': minor
+'@firebase/app-types': minor
+'@firebase/auth': minor
+'@firebase/auth-compat': minor
+'@firebase/auth-types': minor
+'@firebase/database': minor
+'@firebase/database-compat': minor
+'@firebase/database-types': minor
+'@firebase/functions': minor
+'@firebase/functions-compat': minor
+'@firebase/functions-types': minor
+'@firebase/installations': minor
+'@firebase/installations-compat': minor
+'@firebase/installations-types': minor
+'@firebase/messaging': minor
+'@firebase/messaging-compat': minor
+'@firebase/messaging-types': minor
+'@firebase/messaging-interop-types': minor
+'@firebase/performance': minor
+'@firebase/performance-compat': minor
+'@firebase/performance-types': minor
+'@firebase/remote-config': minor
+'@firebase/remote-config-compat': minor
+'@firebase/remote-config-types': minor
+'@firebase/storage': minor
+'@firebase/storage-compat': minor
+'@firebase/storage-types': minor
+---
+
+Release modularized SDKs

.github/CODEOWNERS

@@ -35,6 +35,7 @@
 
 # Database Code
 packages/database @schmidt-sebastian @jsdt @firebase/jssdk-global-approvers
+packages/database-compat @schmidt-sebastian @jsdt @firebase/jssdk-global-approvers
 packages/database-types @schmidt-sebastian @jsdt @firebase/jssdk-global-approvers
 
 # Firestore Code
@@ -45,56 +46,54 @@ integration/firestore  @firebase/firestore-js-team @firebase/jssdk-global-approv
 
 # Storage Code
 packages/storage  @schmidt-sebastian @firebase/jssdk-global-approvers
+packages/storage-compat  @schmidt-sebastian @firebase/jssdk-global-approvers
 packages/storage-types  @schmidt-sebastian @firebase/jssdk-global-approvers
 
 # Messaging Code
 packages/messaging  @zwu52 @chliangGoogle @ciarand @firebase/jssdk-global-approvers
+packages/messaging-compat  @zwu52 @chliangGoogle @ciarand @firebase/jssdk-global-approvers
 packages/messaging-types @zwu52 @chliangGoogle @ciarand @firebase/jssdk-global-approvers
+packages/messaging-interop-types @zwu52 @chliangGoogle @ciarand @firebase/jssdk-global-approvers
 integration/messaging @zwu52 @chliangGoogle @ciarand @firebase/jssdk-global-approvers
 
 # Auth Code
 packages/auth  @bojeil-google @avolkovi @sam-gc @yuchenshi @firebase/jssdk-global-approvers
+packages/auth-compat @avolkovi @sam-gc @yuchenshi @firebase/jssdk-global-approvers
 packages/auth-types  @bojeil-google @avolkovi @sam-gc @yuchenshi @firebase/jssdk-global-approvers
+packages/auth-interop-types  @bojeil-google @avolkovi @sam-gc @yuchenshi @firebase/jssdk-global-approvers
 
 # Testing Code
-packages/testing  @avolkovi @sam-gc @yuchenshi @firebase/jssdk-global-approvers
 packages/rules-unit-testing  @avolkovi @sam-gc @yuchenshi @firebase/jssdk-global-approvers
 
 # Installations
-packages/installations @andirayo @ChaoqunCHEN @firebase/jssdk-global-approvers
-packages/installations-types @andirayo @ChaoqunCHEN @firebase/jssdk-global-approvers
+packages/installations @avolkovi @yoyomyo @firebase/jssdk-global-approvers
+packages/installations-compat @avolkovi @yoyomyo @firebase/jssdk-global-approvers
+packages/installations-types @avolkovi @yoyomyo @firebase/jssdk-global-approvers
 
 # Performance Code
-packages/performance  @alikn @zijianjoy @firebase/jssdk-global-approvers
-packages/performance-types  @alikn @zijianjoy @firebase/jssdk-global-approvers
+packages/performance @jposuna @firebase/jssdk-global-approvers
+packages/performance-compat @jposuna @firebase/jssdk-global-approvers
+packages/performance-types @jposuna @firebase/jssdk-global-approvers
 
 # Analytics Code
 packages/analytics @hsubox76 @Feiyang1 @firebase/jssdk-global-approvers
+packages/analytics-compat @hsubox76 @Feiyang1 @firebase/jssdk-global-approvers
 packages/analytics-types @hsubox76 @Feiyang1 @firebase/jssdk-global-approvers
 
 # Remote Config Code
 packages/remote-config @erikeldridge @firebase/jssdk-global-approvers
+packages/remote-config-compat  @erikeldridge @firebase/jssdk-global-approvers
 packages/remote-config-types @erikeldridge @firebase/jssdk-global-approvers
 
+# App Check Code
+packages/app-check @hsubox76 @Feiyang1 @firebase/jssdk-global-approvers
+packages/app-check-compat @hsubox76 @Feiyang1 @firebase/jssdk-global-approvers
+packages/app-check-types @hsubox76 @Feiyang1 @firebase/jssdk-global-approvers
+packages/app-check-interop-types @hsubox76 @Feiyang1 @firebase/jssdk-global-approvers
+
 # Documentation Changes
 packages/firebase/index.d.ts @egilmorez @firebase/jssdk-global-approvers
 scripts/docgen/content-sources/ @egilmorez @firebase/jssdk-global-approvers
 
 # Changeset
 .changeset @egilmorez @firebase/jssdk-changeset-approvers @firebase/firestore-js-team @firebase/jssdk-global-approvers
-
-# Auth-Exp Code
-packages-exp/auth-exp  @avolkovi @sam-gc @yuchenshi @firebase/jssdk-global-approvers
-packages-exp/auth-compat-exp @avolkovi @sam-gc @yuchenshi @firebase/jssdk-global-approvers
-
-# Installations-Exp Code
-packages/installations-exp @avolkovi @yoyomyo @firebase/jssdk-global-approvers
-packages/installations-types-exp @avolkovi @yoyomyo @firebase/jssdk-global-approvers
-
-# Perf-Exp Code
-packages/performance-exp  @alikn @zijianjoy @firebase/jssdk-global-approvers
-packages/performance-types-exp  @alikn @zijianjoy @firebase/jssdk-global-approvers
-
-# RC-Exp Code
-packages/remote-config-exp  @erikeldridge @firebase/jssdk-global-approvers
-packages/remote-config-compat  @erikeldridge @firebase/jssdk-global-approvers

.github/workflows/test-changed-fcm-integration.yml

@@ -28,6 +28,6 @@ jobs:
         cp config/ci.config.json config/project.json
         yarn
     - name: build
-      run: yarn build:changed fcm-integration --buildAppExp
+      run: yarn build:changed fcm-integration
     - name: Run tests if FCM or its dependencies has changed
       run: xvfb-run yarn test:changed fcm-integration

.github/workflows/test-changed-firestore-integration.yml

@@ -28,6 +28,6 @@ jobs:
         cp config/ci.config.json config/project.json
         yarn
     - name: build
-      run: yarn build:changed firestore-integration --buildAppExp --buildAppCompat
+      run: yarn build:changed firestore-integration
     - name: Run tests if firestore or its dependencies has changed
       run: yarn test:changed firestore-integration

.github/workflows/test-changed-firestore.yml

@@ -28,6 +28,6 @@ jobs:
         cp config/ci.config.json config/project.json
         yarn
     - name: build
-      run: yarn build:changed firestore --buildAppExp --buildAppCompat
+      run: yarn build:changed firestore
     - name: Run tests if firestore or its dependencies has changed
       run: yarn test:changed firestore

.github/workflows/test-changed-misc.yml

@@ -28,6 +28,6 @@ jobs:
         cp config/ci.config.json config/project.json
         yarn
     - name: build
-      run: yarn build:changed misc --buildAppExp
+      run: yarn build:changed misc
     - name: Run tests
       run: yarn test:changed misc

.github/workflows/test-changed.yml

@@ -28,6 +28,6 @@ jobs:
         cp config/ci.config.json config/project.json
         yarn
     - name: build
-      run: yarn build:changed core --buildAppExp
+      run: yarn build:changed core
     - name: Run tests on changed packages
       run: xvfb-run yarn test:changed core

.github/workflows/test-firebase-integration.yml

@@ -28,6 +28,6 @@ jobs:
         cp config/ci.config.json config/project.json
         yarn
     - name: build
-      run: yarn build:changed firebase-integration --buildAppExp
+      run: yarn build:changed firebase-integration
     - name: Run tests on changed packages
       run: yarn test:changed firebase-integration

.github/workflows/update-api-reports.yml

@@ -21,7 +21,8 @@ jobs:
     - name: Yarn install
       run: yarn
     - name: Update API reports
-      run: yarn ts-node-script scripts/exp/update-api-reports.ts
+      # API reports are generated as part of the build
+      run: yarn build
       id: update-api-reports
     - name: Commit & Push changes
       uses: EndBug/add-and-commit@v7

.gitignore

@@ -84,10 +84,8 @@ package-lock.json
 
 # temp folder used by api-extractor
 temp
-packages-exp/**/temp
 
 # temp markdowns generated for individual SDKs
-packages-exp/**/docs
 packages/**/docs
 
 # files generated by api-extractor that should not be tracked