Feat/crt notifications (#267)

* User accounts notifications (#164)

* feat: squash all commits for notification demo

fix: add notification and template choice

feat: sketch mutation for setting the prefeences

fix: arguments for preference selection function

feat: add runtime notification data and notification preferences

fix: notification for runtime events

fix: add notification preference mutation

feat: add email strategy

fix: split Notification into onchain and offchain

fix: add channel created event notifiation

feat: distinguisher between member and channel notifiation

feat: enable offchain notification entities export

fix: notification preferences resolver

fix: migration

feat: default notification preferences

feat: start adding tests

fix: tests

fix: tests

fix: notificatino preference mutation and complete test

fix: add support for offchain dat

fix: missc

fix: format & fix build errors

fix: build and migrations

fix: bugs in setting notifications

fix: add case for notification mutation status

fix: build errors

fix: format

fix: data

* fix: remove non needed entity for migration

export / import scripts allows to specify fields of entities which will be migrated
In this case runtime notification will be migrated partially by offchain and partiall
by handlers

* feat: mark notifications as read

* fix: runtime notification migration generation

* feat: add event notification for video posted

* feat: add video comment

* feat: add chanel verification mutation

* feat: video excluded from app notifications

* feat: channel exclusion

* fix: Channel exclusion

* feat: notification deposit for video reaction

* feat: reaction for comment notification

* feat: refactor and add channel excluded mail template

* fix: email

* feat: regenerate migrations

fix: notifications

fix: misc

* fix: WS_SOURCE for archive

* feat: boilerplate code for notification testing

fix: gql subscriptions

* ♻️ Refactor into object mother like context

* 🩹 Fix: graphql client now working

* 🐛 Logged in client able to send mutation

* ✏️ Fix: set missing notification preferences

* 🩹 Match notification pref names with design

* 🩹 Match notification pref names with design

* 🩹 Fix: SetAccountNotificationPreference resolver

* ✅ Test: Channel created notification

* ✅ Test: FolloChannel notificatino

* ♻️ Ref: notification deposit function

* ✅ Test: Video posted

* ♻️ Ref: addNotification and notification type

* feat: 🎨 create extrinsic file and add make payment to channel

* feat: 🎨 add extra extrinsic for auction notifications

* feat: 🎨 add react to video, comment to video and send payment to channel extrinsics

* refactor: ✨ refactoring code in order to account for manual tests and nft issuance tx status

* feat: 🎨 improve test by adding start auction and start offer

* docs: 📝 review auction bid notification cases and added comments

* fix: 🐛 notify creator on video comment

* fix: 💚 build error

* feat: 🎨 add notification for featured video / nft

* fix: 🐛 channel follower user id

* fix: 🐛 review notification pref parsing

* feat: 🎨 migrate Account to Account with pref (all enabled)

* feat: 🎨 migration from Channel to Channel with verification

* feat: 🎨 offchain notifcations creation timestmap

* refactor: ♻️ Notification code rework to accomodate design specs

* fix: 🎨 notification delivery and fields

* feat: 🎨 no separate notifications

* migration order

* email function rework

* notifications rework

* refactor: ♻️ unify notifications

* fix: 💚 fix notification build error after schema changes

* feat: 🚚 rename and re org utils/notification directory

* fix: 💚 mappings/content/channels tsc errors

* refactor: 💚 fix content/comments and reactions / videos

* fix: 💚 fix content / nft notification deposit

* fix: 💚 channel / resolvers notification deposit

* fix: 💚 Video resolver notification deposit

* fix: 💚 admin resolvers

* fix: 💚 fix direct member payment notification deposit

* fix: 💚 fix notification resolvers

* feat: 🎨 add app root domain

* feat: 🎨 add notification links

* feat: 🎨 notification links

* feat: 🎨 set resolver for setting app_root_domain and notification center

* feat: 🎨 add email content with some formatting

* feat: 🎨 add verify channel resolver with approporiate ChannelVerification entity

* fix: 🔥 no events or notifications are removed

no events or notifications will be removed, since they are now tied to an account and at the mement we don't support account deletion

* feat: 🎨 add royalty payment

* fix: 💚 build errors

* fix: 🩹 patch squid middleware to return 401 for unauth

* fix: 💚 fix ci build

* feat: 🎨 migrate next entity id for account

* temporarely hide integration tests

* fix gitignore

* fix: 💚 eslint fixes

* prettier

* chore: 💚 generate migration data and bump versions

* feat: add channel verification to hidden entities

* feat: 🐛 migrations

* fix: 💚 CI checks on migrations

* notifications visible to accounts

* feat: 🔥 re-establish old visibility policy for notificatinos

* fix: misc

* fix: 🐛 misc fixes for migrations

* feat: 🎨 rename auctionExpired -> timedAuctionExpired and add notificatino for channel suspended

* feat: 🎨 channel suspension resolver

* feat: ✨ better emails

* fix: 🐛 royalty computation and notification id tag

* feat: 🎨 add notification timestamp

* fix: 🐛 purchased nft / channel payment / funds withdrawn notification text

* fix: 🐛 resolvers

* fix: 🐛 VideoHero and channel suspension resolvers

* feat: 💚 fix ci build

* fix: 💚 generate Data.js and add suspension to hidden entities

* fix: 🎨 add channel_suspended to migrated entities

* style: 💄 better name for computeRoyalty args

* fix: 💚 post rebase fixes

* fix: 💚 post rebase fixes

* fix: 💚 post rebase fixes

* Update src/mappings/content/nft.ts

Co-authored-by: attemka <[email protected]>

* Update src/mappings/content/nft.ts

Co-authored-by: attemka <[email protected]>

* Update schema/hidden.graphql

Co-authored-by: Zeeshan Akram <[email protected]>

* Update schema/hidden.graphql

Co-authored-by: Zeeshan Akram <[email protected]>

* Update schema/hidden.graphql

Co-authored-by: Zeeshan Akram <[email protected]>

* Update schema/hidden.graphql

Co-authored-by: Zeeshan Akram <[email protected]>

* Update src/mappings/content/channel.ts

Co-authored-by: Zeeshan Akram <[email protected]>

* Update src/mappings/content/channel.ts

Co-authored-by: Zeeshan Akram <[email protected]>

* Update src/server-extension/resolvers/NotificationResolver/index.ts

Co-authored-by: Zeeshan Akram <[email protected]>

* Update package.json

Co-authored-by: Zeeshan Akram <[email protected]>

* Update src/server-extension/resolvers/VideosResolver/index.ts

Co-authored-by: Zeeshan Akram <[email protected]>

* Update src/server-extension/resolvers/ChannelsResolver/index.ts

Co-authored-by: Zeeshan Akram <[email protected]>

* Update schema/hidden.graphql

Co-authored-by: Zeeshan Akram <[email protected]>

* fix: 🐛 notification created only once when orion_db is active

* fix: 🎨 misc PR comment address

added non-visibility of notification_delivery_* entities

* feat: 🎨 exported state entity migrated

* fix: 🎨 remove joystream patched types

* fix: 🎨 add ypp status to better match the YTS code

* style: 💄 refactor code for page links

* fix: 🎨 setup text for notifications & regenerate schema

* fix: 🐛 PR comments

feat: ♻️ refactor mail code

fix: ⚡ royalty price precision

fix: 🐛 PR comments

perf: ⚡ add max number of concurrent promises for fetching channel followers

fix: 🐛 PR comments

fix: 🐛 PR comments

fix: 🐛 PR comments

regenerate data

Update src/mappings/content/channel.ts

Co-authored-by: Zeeshan Akram <[email protected]>

Update src/server-extension/resolvers/VideosResolver/index.ts

Co-authored-by: Zeeshan Akram <[email protected]>

fix: 🐛 overlay vs orion_db for notification

Now notification are first written in the overlay (if deposited by processor) otherwise they are written directly into orion_db

fix: 🐛 overlay vs orion_db for notification

Now notification are first written in the overlay (if deposited by processor) otherwise they are written directly into orion_db

fix: 🐛 overlay vs orion_db for notification

Now notification are first written in the overlay (if deposited by processor) otherwise they are written directly into orion_db

fix: 🐛 separate mail sent by processor and those sent by server due to overlay presence

fix: 🐛 notification & notification on chain delivery mail deposit

fix: 🐛 notification & notification on chain delivery mail deposit

fix: 🐛 notification & notification on chain delivery mail deposit

* fix: 🐛 rework channel notification data

edit notifications link and text after rework #2

review addNotifications and start fixing channel

comments and Reaction fixes

fix metadata

fix video mappings

fix utils

fix: nft mappings

fix: admin resolvers

fix: video resolvers

fix channel resolvers

* fix: 🐛 rework channel notification data

edit notifications link and text after rework #2

review addNotifications and start fixing channel

comments and Reaction fixes

fix metadata

fix video mappings

fix utils

fix: nft mappings

fix: admin resolvers

fix: video resolvers

fix channel resolvers

* fix: 🐛 rework notification data

edit notifications link and text after rework #2

review addNotifications and start fixing channel

comments and Reaction fixes

fix metadata

fix video mappings

fix utils

fix: nft mappings

fix: admin resolvers

fix: video resolvers

fix channel resolvers

* fix: 🐛 rework notification data

edit notifications link and text after rework #2

review addNotifications and start fixing channel

comments and Reaction fixes

fix metadata

fix video mappings

fix utils

fix: nft mappings

fix: admin resolvers

fix: video resolvers

fix channel resolvers

* fix: 🐛 rework notification data

edit notifications link and text after rework #2

review addNotifications and start fixing channel

comments and Reaction fixes

fix metadata

fix video mappings

fix utils

fix: nft mappings

fix: admin resolvers

fix: video resolvers

fix channel resolvers

* fix: 🐛 rework notification data

edit notifications link and text after rework #2

review addNotifications and start fixing channel

comments and Reaction fixes

fix metadata

fix video mappings

fix utils

fix: nft mappings

fix: admin resolvers

fix: video resolvers

fix channel resolvers

* fix: 🐛 rework notification data

edit notifications link and text after rework #2

review addNotifications and start fixing channel

comments and Reaction fixes

fix metadata

fix video mappings

fix utils

fix: nft mappings

fix: admin resolvers

fix: video resolvers

fix channel resolvers

---------

Co-authored-by: attemka <[email protected]>
Co-authored-by: Zeeshan Akram <[email protected]>

* fix: uninitialized access of NftPurchased type (#179)

* Orion notifications fixes (#195)

* Update squid.yaml

fix: squid.yml version numbering

* Release PR: Orion v3.0.1 (#185)

* fix: processor's overlay bug (#170)

* atlas homepage query speed optimisation (#177)

* fix: gitignored src/model/generated

* add index on video.video_relevance field

* fix typo in developer guide docs

* regenerate db/migrations/*-Data.js file

* Fix/unblock graphql (#183)

* Make session optional and apply changes for auth handles

* Create new middleware for users and use it on some resolvers

* Remove remaining auth guards

* Small docs change

* Add middleware for channel report

* Prettier

* docs: 📝 update changelog (#184)

---------

Co-authored-by: Zeeshan Akram <[email protected]>
Co-authored-by: WRadoslaw <[email protected]>

* fix: 🚑 fix accountId global counter not being migrated (#188)

* style: 🎨 schema & helpers refactor

feat: ✨ resolver for in app notification

* Update the recipient schema

* feat(notification v1): ✨ resolver for in-app notifications

* fix: 🎨 remove inApp delivery entity and inApp resolver no longer used

* fix: 🎨 make notification public and fix linter

* fix: 🐛 PR iter

* test: ✅ test setup missing notificationsj

* test: ✅ add test for set Featured nft

* fix: 🐛 misc fixes after testing

* added referrerChannelId to the Account entity

* fix: ✅ add all tests for missing notifications

* fix: ✅ add all tests for missing notifications

* ci: 💚 add a notifications tests

* fix: 🚨 linter fixes

* fix: 💚 regenerate typeorm-migration scripts

* fix: ✅ update bid related tests and clean test reports

* feat: 🎨 make channel excluded member notification

* feat: 🎨 make channel excluded member notification

* fix: ✨ add event data for channel

* style: 💄 remove unused variant

* fix: ✏️ re check all relation between notification preferences and entities

* fix: ✏️ re check all relation between notification preferences and entities

* fix: ✨ NotificationPreferences Object type for the graphql resolver

* fix: 🐛 distinguish between auction types

* fix: 🐛 distinguish between auction types

---------

Co-authored-by: Zeeshan Akram <[email protected]>
Co-authored-by: WRadoslaw <[email protected]>
Co-authored-by: Theophile Sandoz <[email protected]>
Co-authored-by: attemka <[email protected]>

* fix: 🐛 Video Liked data unitialized (#204)

* Orion notifications video liked (#205)

* fix: 🐛 Video Liked data unitialized

* fix: 🐛 Video Liked data unitialized

* test: ✅ add test for video liked

* test: ✅ add test for video liked

* fix: comment id not added to notification data (#206)

* fix: 🐛 uninitialized notification data fields (#207)

* migrations to 3.1.0 with fix for Overlay data race during migration (#200)

* feat: 🎨 add migration for accounts and channels

* test: ✅ add network test folder

* feat: ✅ add archive dump and export to test migrations

* feat: 🐛 overlay and migration data race

* ci: 💚 add ci checks for migration

* fix: ⚰️ remove dead code

* Mail scheduler feature (#208)

* feat: ✨ start scheduler work

* test: ✅ add test setup

* feat: 🎨 review data model

* feat: 🎨 setup tests and refactor data model

* test: 🎨 add extra seed data

* feat: 🎨 EmailDelivey.status success status changed on sendNew

* feat: 🎨 report entities generated on sendNew

* feat: 🎨 add support for error status

* fix: 🐛 avoid rewriting failedDlivery field on EmailDelivery with old version

* fix: 🎨 add fk for inApp and email delivery no notification entity

* feat: 🎨 add max attempt config variable

* feat: 🎨 seed data for config variable

* fix: 🎨 refactor after rebase

* feat: ✅ start adding test boilerplate code

feat: 🎨 finalize delivery feature

feat: 💚 add ci checks with scheduler tests

fix: 🚨 fix linter

* feat: ⏪ rebase to orion_notifications

* Add an MJML template for email notifications

* Update the links

* Adjust the template after testing it

* Update email links, texts, and icons

* Add avatars in email notifications

* Format amounts of JOYs in the notifications

* Have notification nft links open the nft widget

* Point icon links to GH for now

* Fix the `formatJOY` function

* Add the missing email data

* Update the template for png icons

* Improve avatar code

* Remove unnecessary change

* feat: 🎨 config variables for email

* feat: ✨ add resolvers for setting variables

tested ✅

* feat: enable mail content and remove unused file

* fix: ✅ content delegated to Q&A

* fix: 📦 update package lock

---------

Co-authored-by: Theophile Sandoz <[email protected]>

* Notifications/scheduler main (#210)

* feat: ✨ add main function invocation

* feat: ✨ make dbgen

* fix: 🎨 process env not being read for db connection (#212)

* 👥 Add member ids to `NotificationType` (#219)

* Add memberIds to some `NotificationType`

* Link to members by ids on emails

* Get member avatars by id on emails

* update notification branch with master (#220)

* Update squid.yaml

fix: squid.yml version numbering

* Release PR: Orion v3.0.1 (#185)

* fix: processor's overlay bug (#170)

* atlas homepage query speed optimisation (#177)

* fix: gitignored src/model/generated

* add index on video.video_relevance field

* fix typo in developer guide docs

* regenerate db/migrations/*-Data.js file

* Fix/unblock graphql (#183)

* Make session optional and apply changes for auth handles

* Create new middleware for users and use it on some resolvers

* Remove remaining auth guards

* Small docs change

* Add middleware for channel report

* Prettier

* docs: 📝 update changelog (#184)

---------

Co-authored-by: Zeeshan Akram <[email protected]>
Co-authored-by: WRadoslaw <[email protected]>

* fix: 🚑 fix accountId global counter not being migrated (#188)

* docs: 📝 add back up guide (#196)

* mark 'VideoDeletedByModerator' & 'ChannelDeletedByModerator' events deprecated (#193)

* fix: 🎨 process env not being read for db connection

* test: 🧪 add test for email delivery entity deposit

* fix: 🐛 encoding issues with member handle (#214)

* fix: 🐛 encoding issues with member handle

* fix: 🐛 pr issues

* fix: 🐛 refactor and update changelog

* docs: update version number

* fix: 🚑 account counter (#215)

* fix: 🧪 failing test on migratinos

---------

Co-authored-by: Zeeshan Akram <[email protected]>
Co-authored-by: WRadoslaw <[email protected]>

* update with master (#233)

* Update squid.yaml

fix: squid.yml version numbering

* Release PR: Orion v3.0.1 (#185)

* fix: processor's overlay bug (#170)

* atlas homepage query speed optimisation (#177)

* fix: gitignored src/model/generated

* add index on video.video_relevance field

* fix typo in developer guide docs

* regenerate db/migrations/*-Data.js file

* Fix/unblock graphql (#183)

* Make session optional and apply changes for auth handles

* Create new middleware for users and use it on some resolvers

* Remove remaining auth guards

* Small docs change

* Add middleware for channel report

* Prettier

* docs: 📝 update changelog (#184)

---------

Co-authored-by: Zeeshan Akram <[email protected]>
Co-authored-by: WRadoslaw <[email protected]>

* fix: 🚑 fix accountId global counter not being migrated (#188)

* docs: 📝 add back up guide (#196)

* mark 'VideoDeletedByModerator' & 'ChannelDeletedByModerator' events deprecated (#193)

* fix: 🐛 encoding issues with member handle (#214)

* fix: 🐛 encoding issues with member handle

* fix: 🐛 pr issues

* fix: 🐛 refactor and update changelog

* docs: update version number

* fix: 🚑 account counter (#215)

* Orion v3.0.3 (#224)

* Remove n+1 problem for StorageDataObject (#209)

* Remove n+1 problem for StorageDataObject

* Inform user about incorrect query

* fix: ✨ add global counter migratino to account for 303 (#217)

* Orion 303 final touches (#223)

* feat: ✨ add CORS origins for atlas local testing

* chore: 📝 adds 303 release notes

* Fix typos (#176)

* fix typos

* fix typos

* fix typos

* fix typos

* fix typos

* fix typo

* fix typos

* fix typos

* fix typos

* fix typos

* fix typos

* fix typos

---------

Co-authored-by: WRadoslaw <[email protected]>
Co-authored-by: omahs <[email protected]>

* Orion v3.0.4 - Release (#230)

* 🧮 Aggregate channel payments (#222)

* Fix channels `cumulativeRewardClaimed_DESC` order

* Aggregate channel payments

* Make `cumulativeRewardClaimed` and `cumulativeRewardPaid` non null

* Generate db migrations

* Rename the `cumulativeReward` field

* Re-generate db migrations

* Bump Orion's version

* feat: ⚡ add migration to version 3.0.4 for account id counter (#228)

---------

Co-authored-by: Theophile Sandoz <[email protected]>

---------

Co-authored-by: Zeeshan Akram <[email protected]>
Co-authored-by: WRadoslaw <[email protected]>
Co-authored-by: omahs <[email protected]>
Co-authored-by: Theophile Sandoz <[email protected]>

* 🔨 Fix the notification template (#234)

* Fix notification template

* Remove `!` from the email subject

* Fix asset links

* Notification branch fixes for issued arised during Q&A (#225)

* Update squid.yaml

fix: squid.yml version numbering

* Release PR: Orion v3.0.1 (#185)

* fix: processor's overlay bug (#170)

* atlas homepage query speed optimisation (#177)

* fix: gitignored src/model/generated

* add index on video.video_relevance field

* fix typo in developer guide docs

* regenerate db/migrations/*-Data.js file

* Fix/unblock graphql (#183)

* Make session optional and apply changes for auth handles

* Create new middleware for users and use it on some resolvers

* Remove remaining auth guards

* Small docs change

* Add middleware for channel report

* Prettier

* docs: 📝 update changelog (#184)

---------

Co-authored-by: Zeeshan Akram <[email protected]>
Co-authored-by: WRadoslaw <[email protected]>

* fix: 🚑 fix accountId global counter not being migrated (#188)

* docs: 📝 add back up guide (#196)

* mark 'VideoDeletedByModerator' & 'ChannelDeletedByModerator' events deprecated (#193)

* fix: 🐛 encoding issues with member handle (#214)

* fix: 🐛 encoding issues with member handle

* fix: 🐛 pr issues

* fix: 🐛 refactor and update changelog

* docs: update version number

* fix: 🚑 account counter (#215)

* Orion v3.0.3 (#224)

* Remove n+1 problem for StorageDataObject (#209)

* Remove n+1 problem for StorageDataObject

* Inform user about incorrect query

* fix: ✨ add global counter migratino to account for 303 (#217)

* Orion 303 final touches (#223)

* feat: ✨ add CORS origins for atlas local testing

* chore: 📝 adds 303 release notes

* Fix typos (#176)

* fix typos

* fix typos

* fix typos

* fix typos

* fix typos

* fix typo

* fix typos

* fix typos

* fix typos

* fix typos

* fix typos

* fix typos

---------

Co-authored-by: WRadoslaw <[email protected]>
Co-authored-by: omahs <[email protected]>

* fix(notifications): uninitialized access fields

* fix(notifications): 🐛 add channelId to new auction

* Orion v3.0.4 - Release (#230)

* 🧮 Aggregate channel payments (#222)

* Fix channels `cumulativeRewardClaimed_DESC` order

* Aggregate channel payments

* Make `cumulativeRewardClaimed` and `cumulativeRewardPaid` non null

* Generate db migrations

* Rename the `cumulativeReward` field

* Re-generate db migrations

* Bump Orion's version

* feat: ⚡ add migration to version 3.0.4 for account id counter (#228)

---------

Co-authored-by: Theophile Sandoz <[email protected]>

* Orion v3.1.0 (#238)

* Add granular permissions support for Gateway operator users (#231)

* Add granular permissions support for Gateway operator users

* fix lint issues

* revert docker-compose port change

* mark 'grantPermissions' & 'revokePermissions' input fields are non-nullable & return new permissions instead of boolean

* Set Channel Weight (`setChannelsWeights`) mutation (#232)

* Add granular permissions support for Gateway operator users

* fix lint issues

* add mutation to set channel weight/bias for homepage video relevance

* revert docker-compose port change

* mark 'grantPermissions' & 'revokePermissions' input fields are non-nullable & return new permissions instead of boolean

* bump package version

* update global migration counter map

* bumped package version & updated CHANGELOG

---------

Co-authored-by: Ignazio Bovo <[email protected]>

* Postgres performance improvements (#235)

* add index in video.createdAt field

* add pg_stat_extenstion extenstion for queries stats

* docs: ✨ changelog and fix data-js (#237)

---------

Co-authored-by: Zeeshan Akram <[email protected]>

* Hotfix/3.1.0 (#240)

* Orion v3.1.0 (#238)

* Add granular permissions support for Gateway operator users (#231)

* Add granular permissions support for Gateway operator users

* fix lint issues

* revert docker-compose port change

* mark 'grantPermissions' & 'revokePermissions' input fields are non-nullable & return new permissions instead of boolean

* Set Channel Weight (`setChannelsWeights`) mutation (#232)

* Add granular permissions support for Gateway operator users

* fix lint issues

* add mutation to set channel weight/bias for homepage video relevance

* revert docker-compose port change

* mark 'grantPermissions' & 'revokePermissions' input fields are non-nullable & return new permissions instead of boolean

* bump package version

* update global migration counter map

* bumped package version & updated CHANGELOG

---------

Co-authored-by: Ignazio Bovo <[email protected]>

* Postgres performance improvements (#235)

* add index in video.createdAt field

* add pg_stat_extenstion extenstion for queries stats

* docs: ✨ changelog and fix data-js (#237)

---------

Co-authored-by: Zeeshan Akram <[email protected]>

* fix: 🚑 hotfix default value for channel weight no matter what

---------

Co-authored-by: Zeeshan Akram <[email protected]>

* fix: ✅ add test for comment reply and metadata

* fix: ✨ solve conflicts

* test: ✅ add test for channel verification + refactoring

* chore: 🚨 linter

* fix: 💚 add 10 seconds sleep time for CI checks

* fix: 🐛 channel excluded title

* docs: 📝 typo

---------

Co-authored-by: Zeeshan Akram <[email protected]>
Co-authored-by: WRadoslaw <[email protected]>
Co-authored-by: omahs <[email protected]>
Co-authored-by: Theophile Sandoz <[email protected]>

* 🩹 Fix JOY values in emails and footer (#241)

* Fix JOY values in emails

* Fix email footer

* Test `formatJOY` function

* Use `Number.toFixed` to rewrite `formatJOY`

* Fix demo emails

* 🔧 One more notification email fix (#254)

* Attempt to fix channel avatar on emails

* Improve email template

* Notifications/qa fixes (#250)

* fix: 🐛 unitialized access video posted + misc

* feat: ⚡ batch channel verification

* fix: ⚡ remove non necessary import

* Notifications/qa fixes (#255)

* fix: 🐛 unitialized access video posted + misc

* feat: ⚡ batch channel verification

* fix: ⚡ remove non necessary import

* feat: ✨ batch suspend channel and pLimits promises

* Notifications/qa fixes (#256)

* fix: 🐛 unitialized access video posted + misc

* feat: ⚡ batch channel verification

* fix: ⚡ remove non necessary import

* feat: ✨ batch suspend channel and pLimits promises

* fix: 🐛 typegraphql return type

* Notifications/qa fixes (#255)

* fix: 🐛 unitialized access video posted + misc

* feat: ⚡ batch channel verification

* fix: ⚡ remove non necessary import

* feat: ✨ batch suspend channel and pLimits promises

* fix: 🎨 import

* style: 💄 format

* Post merge fixes

* Regen migrations

* Add new notifications to the schema

* Small changes to accomodate mappings notifications

* Add notifications (w/o events)

* Add rpc events to schema and mapping

* Create notifications types for revenue share

* Create future notifications orion event

* Create future notifications scheduler

* Cover notifications for CRT holders (revenue share, market, sale)

* Send buy, sell events for market and sale to channel instead of followers

* Add missing notifications data for emails

* Remove depricated patch

* Add lock file

* Formating

* Adjust sleep time for migrations tests

* Post merge fixes

* Update lock file

* Formatting

* Fix build and regen files

* Add is short field to video entity (#301)

* add isShort field to video entity

* regenerate db migrations

* remove @joystream/metadata-protobuf patch from assets/patches

* fix lint issue

* Disable both in Appp and eail notifications for video posted events (#299)

* bump package version and update CHANGELOG (#302)

* bump package version and update CHANGELOG

* change release version

* Simple public homefeed query and mutation (#304)

* update graphql schema

* add partial index on 'video.include_in_home_feed' field

* update video view definition to only include public videos

* regenerate migrations

* add dumbPublicFeedVideos custom query

* add setPublicFeedVideos mutation

* fix lint issue

* add arg to skip video IDs

* revert: update video view definition to only include public videos

* add feat. to unset public feed videos

* address requested change

* bump package version and update CHANGELOG

* Update `nara` from `master` (#300)

* Adds mappings for `ChannelAssetsDeletedByModerator` & `VideoAssetsDeletedByModerator` events (#199)

* mark 'VideoDeletedByModerator' & 'ChannelDeletedByModerator' events deprecated

* Implements mappings for 'Content.VideoAssetsDeletedByModerator and 'Content.ChannelAssetsDeletedByModerator' runtime events

* remove unused import

* Nara/crt update (#244)

* feat: build orion

* feat: start generating schema

* fix: extra entities

* fixup!

* fix: continue implementing design specs

* fix: review and fix foreign key relationships

* fix: formatting

* fix: generation errors

* fix: add comment

* fix: relations

* fix: final review

* fixup!

* fix: add ending blocks

* fix: generate type & set typegen to ipv4

* fix: add support for event backward compatibility

* feat: start adding mappings

* fix: continue with mappnigs

* feat: init sale

* feat: patronage decreased to & fixed build

* feat: claim patronage event

* feat: tokens bought on amm

* feat: tokens sold on amm

* fix: add relation between sales and vesting schedules

* feat: add Tokens sold on sale vente

* feat: update upcoming sale

* feat: revenue share issued

* feat: member joined whitelist

* feat: amm deactivated

* feat: burned token

* feat: transfer policy changed to permissionless

* feat: sale finalized

* feat: finish mappings

* fix: review

* fix: remove cascade deletions

* fix: renaming & formatting

* fixup!

* fixup!

* fix: patched protobuf packages with token proto

* feat: update metadata and add event handler scheleton

* feat: token metadata

* feat: sale metadata

* fix: review comments

* fix: formatting

* fix: revenue

* Revert "fix: revenue"

This reverts commit 0821abe.

* fix: token status after sale

* fix: fixmes

* fix: formatting

* fix: funds accounting during sale

* fix: amount accounting

* fix: linter

* fix: review

* fix: review 2

* fix: review

* fix: linter

* feat: migration for new db scheam

* fix: update event versions

* fix: patch types with crt_release types

* fix: patch types

* fix: generate all events versions since mainnet

* fix: temp fix after event version generation

* fix: event versioning

* fix: add migration

* fix: mignations

* fix: solve channel not being added

* fix: add id to TokenChannel

* fix: non-nullable deleted field set

* fix: format

* feat: creator token init sale re enabling

* feat: re enable sale init code

* fix: update types

* fix: amm id

* fix: id computation for revenue share

* fix: amm id computation for token

* fix: issuer transfer accounting

* fix: amm tx id

* fix: destination accounting

* feat: minor fix on holder transfer processing

* fix: re-enable metadata

* fix: metadata parsing

* fix: post reword cleanup

* fix: format

* fix: silence ci checks

* fix: event version

* fix: address PR changes

I edited all the entity that have a composite index like TokenAccount so that they have
a synthetic ID and an optionally unique @Index

* fix: add hidden entities conditions

* fix: add extra fields to token in order to keep track of ongoing status

* fix: build errors

* fix: adapt mapping to new token fields

* fix: format

* feat: add trailer video entity

this is required so we can simply make trailer video hidden if video is hidden

* fix: linter

* chore: prettier

* fix: from PR review

* fix: vesting schedule schema & mappings

I have replaced the vesting schedule back to the original schema with:
- VestingSchedule: holding vesting schedule information such being amount agnostic
- VestedAccount: contains information regarded to a vested account, the goal is to mimic the
runtime logic

* fix: burning from vesting

* patch: metadata-protobuf package

* patch: metadata-protobuf package

* fix: generate migrations

* fix: purchase token on sale

* Update schema/token.graphql

Co-authored-by: Leszek Wiesner <[email protected]>

* Update schema/token.graphql

Co-authored-by: Leszek Wiesner <[email protected]>

* fix: address PR

* fix: hidden entities

* fix: migration ok

* feat: add extra check for migrations

* fix: docker network

* fix: format

* fix: remove unrequired constraint

* fix: 🐛 post rebase fixes

* feat: 🎨 add metadata processing for issue token

* feat(crt-v1): ✨ chain metadata for v 2003

* fix(crt-v1): 🚑 comment out view element for orion playgroud

* fix(crt-v1): 🎨 add playground config variable to .env

* feat: ✅ add tests

* fix(crt-v1): 📦 packages and patches

* fix(crt-v1): ✅ update entity id used and other minor fixes

* fix(crt-v1): ✅ update entity id used and other minor fixes

* test(crt-v1): 🐛 misc fixes to have tests working

* test(crt-v1): 🐛 misc fixes to have tests working

* fix(crt-v1): 🐛 metadata and trailer video

* feat(crt-v1): 🎨 update types

* fix(crt-v1): ✨ Add correct Ratio denomination (Permill)

* update with master

* fix: 🐛 metadata not being set

* fix: 🐛 parameters order

* test: 🧪 fixing integration tests

* test(crt-v1): 🧪 fix integration tests

* feat(crt-v1): ✨ last price for token and recovered field for rev share part

* feat: ✨ add resolver for dividend amount

* feat(crt-v1): ✨ start adding channel fields for trackingtotal revenue

* feat(crt-v1): ✨ add utils for royalty computation

* feat(crt-v1): ✨ cumulative revenue on channel

* feat(crt-v1): ✨ add resolver for transferrable amount

* fix(crt-v1): ✨ add `acquiredAt` to pinpoint latest vesting schedule for account

* Token metadata processing update

* Prettier

* chore(crt-v1): ⚡ dbgen

* fix(crt-v1): 🧪 fix integration tests

* fix(crt-v1): 🐛 missing fields in token sale vesting source

* test(crt-v1): 🧪 test for transferrable balance amount

* fix(crt-v1): 🐛 transferrable amount

* test: 🧪 update tests after resolver fix

* fix: 🐛 error on vesting schedules array

* fix: 🎨 CI fixes

* docs: update gitignore

* fix: 🚨 prettier

* build: 📌 chai depnedencies

---------

Co-authored-by: Leszek Wiesner <[email protected]>
Co-authored-by: WRadoslaw <[email protected]>

* Clear benefits even if not passed (#282)

* 🤑 Fix revenue share dividend estimation (#297)

* Fix on revenue share dividend estimation

* Fix type on result

* 🛕 Historical revenue share participants (#286)

* New field for revenue share

* Set potential revenue share particitants at the time of start

* fix: .gitignore not working

* fix lint issues

* re-generate db migrations

* commit register.html.mst file

* fix: notifications integration test

---------

Co-authored-by: Ignazio Bovo <[email protected]>
Co-authored-by: Leszek Wiesner <[email protected]>
Co-authored-by: WRadoslaw <[email protected]>
Co-authored-by: WRadoslaw <[email protected]>

* Revert "Update `nara` from `master` (#300)" (#306)

This reverts commit 887427c.

* generate auth api docs and types

* regenerate migrations

* address requested changes

* fix: auction AuctionWon/AuctionLost notifications preferences

* add notification preferences for CRT notifications

* add feature to do futures notifications delivery

* remove 'FutureNotificationOrionEvent' entity

* add default notification preferences for crt notification

* fix: email scheduler tests

---------

Co-authored-by: Ignazio Bovo <[email protected]>
Co-authored-by: attemka <[email protected]>
Co-authored-by: Zeeshan Akram <[email protected]>
Co-authored-by: Theophile Sandoz <[email protected]>
Co-authored-by: omahs <[email protected]>
Co-authored-by: Leszek Wiesner <[email protected]>
Co-authored-by: Zeeshan Akram <[email protected]>

db/migrations/1709203295214-Views.js → db/migrations/1709387168809-Views.js

@@ -1,8 +1,8 @@
 
 const { getViewDefinitions } = require('../viewDefinitions')
 
-module.exports = class Views1709203295214 {
-  name = 'Views1709203295214'
+module.exports = class Views1709387168809 {
+  name = 'Views1709387168809'
 
   async up(db) {
     const viewDefinitions = getViewDefinitions(db);

schema/auth.graphql

@@ -175,6 +175,15 @@ type AccountNotificationPreferences {
   fundsFromCouncilReceived: NotificationPreference! #v2
   fundsToExternalWalletSent: NotificationPreference! #v2
   fundsFromWgReceived: NotificationPreference! # v2
+  crtIssued: NotificationPreference!
+  crtMarketStarted: NotificationPreference!
+  crtMarketMint: NotificationPreference!
+  crtMarketBurn: NotificationPreference!
+  crtSaleStarted: NotificationPreference!
+  crtSaleMint: NotificationPreference!
+  crtRevenueShareStarted: NotificationPreference!
+  crtRevenueSharePlanned: NotificationPreference!
+  crtRevenueShareEnded: NotificationPreference!
 }
 
 type NotificationPreference {

schema/events.graphql

@@ -70,6 +70,13 @@ union EventData =
   | ChannelAssetsDeletedByModeratorEventData
   | VideoAssetsDeletedByModeratorEventData
   | VideoReactionEventData
+  | CreatorTokenIssuedEventData
+  | CreatorTokenMarketStartedEventData
+  | CreatorTokenMarketMintEventData
+  | CreatorTokenMarketBurnEventData
+  | CreatorTokenSaleStartedEventData
+  | CreatorTokenSaleMintEventData
+  | CreatorTokenRevenueSplitIssuedEventData
 
 # Needed when adding a new runtime notification
 type CommentReactionEventData {
@@ -445,3 +452,56 @@ type VideoAssetsDeletedByModeratorEventData {
   "why the video assets were deleted"
   rationale: String!
 }
+
+type CreatorTokenIssuedEventData {
+  "Token that was issued"
+  token: CreatorToken
+}
+
+type CreatorTokenMarketStartedEventData {
+  "Token for which market was created"
+  token: CreatorToken
+
+  "Details of the created market"
+  ammCurve: AmmCurve
+}
+
+type CreatorTokenMarketMintEventData {
+  "Token for which transaction happened"
+  token: CreatorToken
+
+  "Details of the transaction that happened"
+  ammMintTransaction: AmmTransaction
+}
+
+type CreatorTokenMarketBurnEventData {
+  "Token for which transaction happened"
+  token: CreatorToken
+
+  "Details of the transaction that happened"
+  ammBurnTransaction: AmmTransaction
+}
+
+type CreatorTokenSaleStartedEventData {
+  "Token for which sale was created"
+  token: CreatorToken
+
+  "Details of the created sale"
+  sale: Sale
+}
+
+type CreatorTokenSaleMintEventData {
+  "Token for which transaction happened"
+  token: CreatorToken
+
+  "Details of the transaction that happened"
+  saleTransaction: SaleTransaction
+}
+
+type CreatorTokenRevenueSplitIssuedEventData {
+  "Token for which split was issued"
+  token: CreatorToken
+
+  "Details of the revenue split"
+  revenueShare: RevenueShare
+}

schema/notifications.graphql

@@ -72,6 +72,9 @@ type Notification @entity {
   "timestamp"
   createdAt: DateTime!
 
+  "block after which notification should be dispatched (if null, then it should be dispatched immediately)"
+  dispatchBlock: Int
+
   "recipient"
   recipient: RecipientType!
 }
@@ -112,6 +115,16 @@ union NotificationType =
   | HigherBidPlaced # higher bid than yours made
   | AuctionWon # auction won
   | AuctionLost # auction lost
+  | CreatorTokenIssued
+  | CreatorTokenMarketStarted
+  | CreatorTokenSaleStarted
+  | CreatorTokenMarketMint
+  | CreatorTokenMarketBurn
+  | CreatorTokenSaleMint
+  | CreatorTokenRevenueShareStarted
+  | CreatorTokenRevenueSharePlanned
+  | CreatorTokenRevenueShareEnded
+
 type ChannelSuspended @variant {
   phantom: Int
 }
@@ -409,3 +422,138 @@ type NftRoyaltyPaid @variant {
   "bid amount"
   amount: BigInt!
 }
+
+type CreatorTokenIssued @variant {
+  "channel title for notification text"
+  channelTitle: String!
+
+  "symbol of the token"
+  tokenSymbol: String!
+
+  "channel Id used for link"
+  channelId: String!
+}
+
+type CreatorTokenSaleStarted @variant {
+  "channel title for notification text"
+  channelTitle: String!
+
+  "symbol of the token"
+  tokenSymbol: String!
+
+  "channel Id used for link"
+  channelId: String!
+}
+
+type CreatorTokenMarketStarted @variant {
+  "channel title for notification text"
+  channelTitle: String!
+
+  "symbol of the token"
+  tokenSymbol: String!
+
+  "channel Id used for link"
+  channelId: String!
+}
+
+type CreatorTokenMarketMint @variant {
+  "handle of member that minted tokens"
+  minterHandle: String!
+
+  "id of member that minted tokens"
+  minterId: String!
+
+  "amount of tokens that user minted"
+  mintedTokenAmount: BigInt!
+
+  "amount of joy that user used for minting"
+  paiedJoyAmount: BigInt!
+
+  "symbol of the token"
+  tokenSymbol: String!
+}
+
+type CreatorTokenMarketBurn @variant {
+  "handle of member that burned tokens"
+  burnerHandle: String!
+
+  "id of member that burned tokens"
+  burnerId: String!
+
+  "amount of tokens that user burned"
+  burnedTokenAmount: BigInt!
+
+  "amount of joy that user received for burning"
+  receivedJoyAmount: BigInt!
+
+  "symbol of the token"
+  tokenSymbol: String!
+}
+
+type CreatorTokenSaleMint @variant {
+  "handle of member that minted tokens"
+  minterHandle: String!
+
+  "id of member that minted tokens"
+  minterId: String!
+
+  "amount of tokens that user minted"
+  mintedTokenAmount: BigInt!
+
+  "amount of joy that user used for minting"
+  paiedJoyAmount: BigInt!
+
+  "symbol of the token"
+  tokenSymbol: String!
+}
+
+type CreatorTokenRevenueShareStarted @variant {
+  "channel title for notification text"
+  channelTitle: String!
+
+  "channel title for notification avatar"
+  channelId: String!
+
+  "symbol of the token"
+  tokenSymbol: String!
+
+  "id of created revenue share to verify its' viability in future"
+  revenueShareId: String!
+
+  "id of token"
+  tokenId: String!
+}
+
+type CreatorTokenRevenueSharePlanned @variant {
+  "channel title for notification text"
+  channelTitle: String!
+
+  "channel title for notification avatar"
+  channelId: String!
+
+  "symbol of the token"
+  tokenSymbol: String!
+
+  "block on which split is planned to start"
+  plannedAt: Int!
+
+  "id of created revenue share to verify its' viability in future"
+  revenueShareId: String!
+}
+
+type CreatorTokenRevenueShareEnded @variant {
+  "channel title for notification text"
+  channelTitle: String!
+
+  "channel title for notification avatar"
+  channelId: String!
+
+  "symbol of the token"
+  tokenSymbol: String!
+
+  "id of created revenue share to verify its' viability in future"
+  revenueShareId: String!
+
+  "id of token"
+  tokenId: String!
+}

schema/token.graphql

@@ -93,7 +93,7 @@ type CreatorToken @entity {
   currentSale: Sale
 
   "current revenue share if ongoing"
-  currentRenvenueShare: RevenueShare
+  currentRevenueShare: RevenueShare
 
   "number of vested transfer completed"
   numberOfVestedTransferIssued: Int!

src/mail-scheduler/index.ts

@@ -1,5 +1,6 @@
-import { EntityManager } from 'typeorm'
+import { EntityManager, IsNull, LessThanOrEqual } from 'typeorm'
 import { EmailDeliveryAttempt, EmailFailure, NotificationEmailDelivery } from '../model'
+import { getCurrentBlockHeight } from '../utils/blockHeight'
 import { ConfigVariable, config } from '../utils/config'
 import { uniqueId } from '../utils/crypto'
 import { globalEm } from '../utils/globalEm'
@@ -11,9 +12,14 @@ export async function getMaxAttempts(em: EntityManager): Promise<number> {
 }
 
 export async function mailsToDeliver(em: EntityManager): Promise<NotificationEmailDelivery[]> {
+  const { lastProcessedBlock } = await getCurrentBlockHeight(em)
   const result = await em.getRepository(NotificationEmailDelivery).find({
     where: {
       discard: false,
+      notification: [
+        { dispatchBlock: IsNull() },
+        { dispatchBlock: LessThanOrEqual(lastProcessedBlock) },
+      ],
     },
     relations: {
       notification: { account: true },