Skip to content

rework how materialized views are updated #3

Description

@natebrennand

just noticed that Postgres actually lacks incremental updating of materialized views. this means that the materialized view tables are locked for the ~50 seconds that it takes to update them. this isn't really acceptable since it would just cause our queries to them to timeout.


proposed resolution:

  1. remake materialized views w/ different names then rename them
    • would be done in a PG transaction (means every step works or no steps work)
    • would reduce the update time
    • still takes ~50 seconds
  2. how many indexes can we add?
    • experiment and see if we can index enough things to make the materialized view creation faster
  3. try a different database?
    • MySQL doesn't seem to have this from my brief googling (possibly with this plugin)
    • Oracle actually does have them (but there's licensing fees I think?)

CC @adicu/density @rbtying

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions