Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

PostgreSQL migration #12048

Open
samuelfangjw opened this issue Feb 2, 2023 · 0 comments · Fixed by #12917 or #13095
Open

PostgreSQL migration #12048

samuelfangjw opened this issue Feb 2, 2023 · 0 comments · Fixed by #12917 or #13095
Labels
c.Epic Feature/task that is worth many smaller sub-features/sub-tasks committers only Difficult; better left for committers or more senior developers

Comments

@samuelfangjw
Copy link
Member

The epic keeps track of issues related to PostgreSQL migration.

We will be working on the v9-migration branch.
@samuelfangjw samuelfangjw added committers only Difficult; better left for committers or more senior developers c.Epic Feature/task that is worth many smaller sub-features/sub-tasks labels Feb 2, 2023
samuelfangjw added a commit that referenced this issue Feb 2, 2023
@samuelfangjw
[#12048] Set up github action workflows
57b0f99
@samuelfangjw samuelfangjw mentioned this issue Feb 5, 2023
Merged
samuelfangjw added a commit that referenced this issue Feb 6, 2023
@samuelfangjw
[#12048] v9: Skeleton implementation (#12056)
fab110f
samuelfangjw added a commit that referenced this issue Feb 6, 2023
@samuelfangjw
[#12048] Set up github action workflows
6e3b1a9
samuelfangjw added a commit that referenced this issue Feb 6, 2023
@samuelfangjw
[#12048] v9: Skeleton implementation (#12056)
bd3b623
@hhdqirui hhdqirui mentioned this issue Feb 8, 2023
Merged
@daongochieu2810 daongochieu2810 mentioned this issue Feb 9, 2023
Merged
samuelfangjw pushed a commit that referenced this issue Feb 9, 2023
@daongochieu2810
[#12048] Add isMigrated flag to course (#12063)
63d7f66
@daongochieu2810 daongochieu2810 mentioned this issue Feb 10, 2023
Merged
@domlimm domlimm mentioned this issue Feb 10, 2023
Merged
samuelfangjw pushed a commit that referenced this issue Feb 10, 2023
@daongochieu2810
[#12048] Add is migrated flag to datastore account (#12070)
2b8f6d8
@samuelfangjw samuelfangjw mentioned this issue Feb 10, 2023
Merged
samuelfangjw pushed a commit that referenced this issue Feb 10, 2023
@hhdqirui
[#12048] Create Notification Entity for PostgreSQL migration (#12061)
9198839
@domlimm domlimm mentioned this issue Feb 10, 2023
Closed
hhdqirui pushed a commit to hhdqirui/teammates that referenced this issue Feb 11, 2023
@daongochieu2810 @hhdqirui
[TEAMMATES#12048] Add isMigrated flag to course (TEAMMATES#12063)
8383d87
hhdqirui pushed a commit to hhdqirui/teammates that referenced this issue Feb 11, 2023
@daongochieu2810 @hhdqirui
[TEAMMATES#12048] Add is migrated flag to datastore account (TEAMMATE…
ea77a29 
…S#12070)
hhdqirui pushed a commit to hhdqirui/teammates that referenced this issue Feb 11, 2023
@samuelfangjw @hhdqirui
[TEAMMATES#12048] Set up github action workflows
9c46277
hhdqirui pushed a commit to hhdqirui/teammates that referenced this issue Feb 11, 2023
@samuelfangjw @hhdqirui
[TEAMMATES#12048] v9: Skeleton implementation (TEAMMATES#12056)
522e93a
hhdqirui pushed a commit to hhdqirui/teammates that referenced this issue Feb 11, 2023
@daongochieu2810 @hhdqirui
[TEAMMATES#12048] Add isMigrated flag to course (TEAMMATES#12063)
d0409b5
hhdqirui pushed a commit to hhdqirui/teammates that referenced this issue Feb 11, 2023
@daongochieu2810 @hhdqirui
[TEAMMATES#12048] Add is migrated flag to datastore account (TEAMMATE…
6a09b75 
…S#12070)
This was referenced Feb 11, 2023
Closed
Merged
samuelfangjw pushed a commit that referenced this issue Feb 11, 2023
@hhdqirui
[#12048] Create notification DB layer for v9 migration (#12075)
39d13af
@daongochieu2810 daongochieu2810 mentioned this issue Feb 11, 2023
Merged
@hhdqirui hhdqirui mentioned this issue Feb 11, 2023
Merged
samuelfangjw pushed a commit that referenced this issue Feb 11, 2023
@daongochieu2810
[#12048] Add UsageStatistics entity and db (#12076)
74edda6
@hhdqirui hhdqirui mentioned this issue Feb 13, 2023
Merged
@daongochieu2810 daongochieu2810 mentioned this issue Feb 13, 2023
Merged
@FergusMok FergusMok mentioned this issue Apr 22, 2024
Closed
@yuanxi1 yuanxi1 mentioned this issue Apr 22, 2024
Closed
5 tasks
@marquestye marquestye mentioned this issue Apr 23, 2024
Merged
@FergusMok FergusMok mentioned this issue Apr 23, 2024
Merged
@NicolasCwy NicolasCwy mentioned this issue Apr 23, 2024
Merged
1 task
FergusMok added a commit that referenced this issue Apr 24, 2024
@FergusMok
[#12048] Add database changes and speed up seeding (#13085)
fa8be50 
* Add changes

* Speed up seeding
NicolasCwy added a commit that referenced this issue Apr 24, 2024
@NicolasCwy @FergusMok @marquestye
[#12048] Fix seed, migration and verification script for course verif…
4c4a900 
…ication (#13086)

* Add migration and verification script for feedback session

* Optimize data migration

* Add counts verification script

* Abstract seed account method

* Combine non-course and course seed methods

* Fix migration script

* Add additional logs

Co-authored-by: Marques Tye Jia Jun <97437396+marquestye@users.noreply.github.com>

* Comment out usage statistics, account requests, notifications, add null to student google id
---------

Co-authored-by: YX Z <yxz@YXs-MacBook-Air-2.local>
Co-authored-by: Fergus Mok <FergusMok1@gmail.com>
Co-authored-by: Marques Tye Jia Jun <97437396+marquestye@users.noreply.github.com>
NicolasCwy added a commit that referenced this issue Apr 24, 2024
@NicolasCwy
[#12048] Add patch script for account request and notifications to am…
620e05d 
…end createdAt field (#13077)

* Change account request and notification verification

* Add script to patch notification created time

* Add script to patch account request created time
@NicolasCwy NicolasCwy mentioned this issue Apr 24, 2024
Merged
@FergusMok FergusMok mentioned this issue Apr 24, 2024
Merged
FergusMok added a commit that referenced this issue Apr 24, 2024
@FergusMok
[#12048] Prepare for migration testing (#13089)
01b3209 
* Add Marques' IndexCourseFields

* Set max response count at 10000

* Add scripts

* Add spacing
@NicolasCwy NicolasCwy mentioned this issue Apr 24, 2024
Merged
@marquestye marquestye mentioned this issue Apr 24, 2024
Merged
@FergusMok FergusMok mentioned this issue Apr 24, 2024
Merged
@NicolasCwy NicolasCwy mentioned this issue Apr 24, 2024
Merged
@mingyuanc mingyuanc mentioned this issue Apr 24, 2024
Merged
mingyuanc added a commit that referenced this issue Apr 24, 2024
@mingyuanc
Merge pull request #13094 from mingyuanc/12048-data-migration-fix-stu…
f83d0d8 
…dent-email-seed

[#12048] data migration fix student email seed
@FergusMok FergusMok mentioned this issue Apr 24, 2024
Merged
NicolasCwy pushed a commit that referenced this issue Apr 24, 2024
@FergusMok
[#12048] Delete redundant index (#13095)
1d7fb0c 
* Add null check

* Delete index
NicolasCwy added a commit that referenced this issue Apr 24, 2024
@NicolasCwy
[#12048] Add dangling course delete script (#13090)
49caf5b 
* Add remove dangling course script
weiquu added a commit that referenced this issue Apr 28, 2024
@yuanxi1 @weiquu
[#12048] Migrate FeedbackRubricQuestionsE2E (#13078)
a2a9ef3 
* Add e2e test

* Migrate all tests

* Update xml

---------

Co-authored-by: YX Z <yxz@YXs-MacBook-Air-2.local>
Co-authored-by: Wei Qing <48304907+weiquu@users.noreply.github.com>
FergusMok added a commit that referenced this issue May 2, 2024
@FergusMok
[#12048] Migrate SubmitFeedbackResponseAction tests (#13033)
34248a0 
* Skeleton till shouldAllowIfBeforeDeadline

* Save progress

* Save progress

* Fix all tests

* Fix linting

* Remove redundant

* Refactor to fit integration tests structure

* Add breaking changes

* Add flush

* Fix linting

* Fix clean-up from access control
@NicolasCwy NicolasCwy mentioned this issue May 3, 2024
Merged
NicolasCwy added a commit that referenced this issue May 3, 2024
@NicolasCwy
[#12048] Optimse account request - createdAt patch script (#13107)
88353da 
* Optimise account request patch script

* Fix incorrect console prefix

* fix buffer not flushing
This was referenced May 6, 2024
Merged
Merged
NicolasCwy added a commit that referenced this issue May 6, 2024
@NicolasCwy
Merge pull request #13112 from NicolasCwy/v9-course-migration
6de4d94 
[#12048] Update v9 course migration feature branch
wkurniawan07 added a commit that referenced this issue May 12, 2024
@FergusMok @NicolasCwy @wkurniawan07
[#12048] Remove null default section (#13040)
06bfafd 
* Add changes

* Add missing

---------

Co-authored-by: Nicolas <25302138+NicolasCwy@users.noreply.github.com>
Co-authored-by: Wilson Kurniawan <wkurniawan.92@gmail.com>
FergusMok pushed a commit that referenced this issue Jun 22, 2024
@NicolasCwy @marquestye
[#12048] Fix course migration script (#13111)
0798e80 
* TO REMOVE: Code for development

* FIXING COURSES

* TO REMOVE TEST SCRIPT

* Add logger class

* Remove unused course script

* Comment out chain verification

* Fix seed error if entity count is too low

* Comment out seed notif

* Comment out notification seed

* Remove account request seed

* Verify section migration

* Fix team migration

* Remove previously added column

* Fix student migration

* Add back updated timestamp

* Add more fixes for students

* Verified feedback session migration

* Remove previously added constraint

To be fixed in the main branch instead

* Verify feedback questions migration

* Verify Feedback response migration

* Fix broken seed for feedback questions and response

* Remove feedback response updatedAtTimestamp annotation

* Verify instructor migration

* Fix instructor seed - name

* Verify feedback response comment migration

* Fix Deadline extension

* Remove code used for development

* Remove verbose logging for deadline extension

---------

Co-authored-by: marquestye <e0360581@u.nus.edu>
domoberzin added a commit that referenced this issue Jul 10, 2024
@weiquu @mingyuanc @domoberzin
[#12048] Migrate InstructorCourseStudentDetailsEditPageE2ETest (#13069)
13a1891 
* migrate

* get name from section and team

* update team

* fix data issues

---------

Co-authored-by: Ching Ming Yuan <cmingyuan123@gmail.com>
Co-authored-by: domoberzin <74132255+domoberzin@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
c.Epic Feature/task that is worth many smaller sub-features/sub-tasks committers only Difficult; better left for committers or more senior developers
Projects
None yet
Milestone
No milestone
2 participants
@weiquu @samuelfangjw