Skip to content

Commit

Permalink
Better control of model rebuild
Browse files Browse the repository at this point in the history
The model only needs to be rebuilt when the resolution of field types in an extensible model modifies the field type. This modification only occurs if the field is itself of an extensible type. In this case, the original type is replaced by the class aggregated for the original type.
  • Loading branch information
lmignon committed Nov 23, 2023
1 parent 8f9fb77 commit 1fd4b35
Show file tree
Hide file tree
Showing 2 changed files with 45 additions and 12 deletions.
39 changes: 39 additions & 0 deletions news/19.bugfix
Original file line number Diff line number Diff line change
@@ -0,0 +1,39 @@
Fix problem with unresolved annotated types in the aggregated model.

At the end of the registry building process, the registry contains the aggregated
model. Each aggregated model is the result of the build of a new class based on
a hierarchy of all the classes defined as 'extends' of the same base class. The
order of the classes hierarchy is defined by the order in which the classes are
loaded by the class loader or by a specific order defined by the developer when
the registry is built.

The last step of the build process is to resolve all the annotated types in the
aggregated model and rebuild the pydantic schema validator. This step is necessary
because when the developer defines a model, some fields can be annotated with a
type that refers to a class that is an extendable class. It's therefore necessary
to update the annotated type with the aggregated result of the specified
extendable class and rebuild the pydantic schema validator to take into account
the new annotated types.

Prior to this commit, the resolution of the annotated types was not done in a
recursive way and the rebuild of the pydantic schema validator was only done
just after the resolution of an aggregated class. This means that if a class A
is an extendable defining a fields annotated with a type that refers to a class
B, and if the class B is an extendable class defining a field of type C,
the annotated type of the field of the class A was resolved with the aggregated
model of the class B but we didn't resolve th annotated type of the field ot type
B with the aggregated model of the type C. Therefore when the pydantic schema
validator was rebuilt after the resolution of the class A, if the class B was
not yet resolved and therefore the pydantic schema validator was not rebuilt,
the new schema validator for the class A was not correct because it didn't take
into account the aggregated model of the class C nor the definition of extra
fields of the aggregated model of the class B.

This commit changes the resolution of the annotated types to be recursive. Therefore
when the pydantic schema validator is rebuilt, we are sure that all referenced
subtypes are resolved and defines a correct schema validator. In the
same time, when an aggregated class is resolved, it's marked as resolved to avoid
to resolve it again and rebuild the pydantic schema validator again for nothing.
In addition to resolve the initial problem, this commit also improves
the performance of the build process because schema validators rebuilds are
done only once per aggregated class.
18 changes: 6 additions & 12 deletions src/extendable_pydantic/main.py
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
import inspect
import typing
import warnings
from typing import Any, Dict, List, Optional, cast, no_type_check, Set
from typing import Any, Dict, List, Optional, cast, no_type_check

from extendable import context, main
from extendable.main import ExtendableMeta
Expand All @@ -28,6 +28,8 @@


class ExtendableModelMeta(ExtendableMeta, ModelMetaclass):
__xreg_fields_resolved__: bool = False

@no_type_check
@classmethod
def _build_original_class(metacls, name, bases, namespace, **kwargs):
Expand All @@ -45,6 +47,7 @@ def _prepare_namespace(
namespace = super()._prepare_namespace(
name=name, bases=bases, namespace=namespace, extends=extends, **kwargs
)
namespace["__xreg_fields_resolved__"] = False
return namespace

@no_type_check
Expand Down Expand Up @@ -93,13 +96,9 @@ def _resolve_submodel_fields(
"""Replace the original field type into the definition of the field by the one
from the registry."""
registry = registry if registry else context.extendable_registry.get()
resolved: Set["ExtendableModelMeta"] = getattr(
registry, "_resolved_models", set()
)
if cls in resolved:
if cls.__xreg_fields_resolved__:
return
resolved.add(cls)
registry._resolved_models = resolved # type: ignore[union-attr]
cls.__xreg_fields_resolved__ = True
to_rebuild = False
if issubclass(cls, BaseModel):
for field_name, field_info in cast(BaseModel, cls).model_fields.items():
Expand All @@ -117,7 +116,6 @@ def _resolve_submodel_fields(
class RegistryListener(ExtendableRegistryListener):
def on_registry_initialized(self, registry: ExtendableClassesRegistry) -> None:
self.resolve_submodel_fields(registry)
self.rebuild_models(registry)

def before_init_registry(
self,
Expand All @@ -130,10 +128,6 @@ def before_init_registry(
if "extendable_pydantic" not in module_matchings:
module_matchings.insert(0, "extendable_pydantic.models")

def rebuild_models(self, registry: ExtendableClassesRegistry) -> None:
for cls in registry._extendable_classes.values():
cast(BaseModel, cls).model_rebuild(force=True)

def resolve_submodel_fields(self, registry: ExtendableClassesRegistry) -> None:
for cls in registry._extendable_classes.values():
if issubclass(type(cls), ExtendableModelMeta):
Expand Down

0 comments on commit 1fd4b35

Please sign in to comment.