Skip to content

Add support for inherited nullability from PHP#11814

Closed
delacry wants to merge 2 commits into
doctrine:3.7.xfrom
delacry:nullability
Closed

Add support for inherited nullability from PHP#11814
delacry wants to merge 2 commits into
doctrine:3.7.xfrom
delacry:nullability

Conversation

@delacry

@delacry delacry commented Jan 29, 2025

Copy link
Copy Markdown
Contributor

Closes #9744 and #11797, relates to #11620.

It's made as opt-in feature so we don't cause BC break, it can be enabled per mapping driver:

$driver = new AttributeDriver($paths, inferNullabilityFromPHPType: true);

In Symfony:

doctrine:
    orm:
        mappings:
            App:
                type: attribute
                infer_nullability_from_php_type: true

In Nette:

doctrine.orm:
    managers:
        default:
            mapping:
                App:
                    inferNullabilityFromPHPType: true

Example code before:

#[Column(nullable: true)]
private ?string $property = null;

#[ManyToOne]
#[JoinColumn(nullable: false)]
private Entity $entity;

#[OneToOne] // db = nullable, php = not nullable
private Entity $test;

Example code after:

#[Column] 
private ?string $property = null;

#[ManyToOne] 
private Entity $entity;

#[OneToOne]
#[JoinColumn(nullable: true)] // to keep previous behavior
private Entity $test;

I have already tested it also on mid-sized project and new generated migration was ok (I already migrated it, ~25 queries), with default configuration. It helped me discover few database rows with null where should not be null, and it would cause app error if those entities were loaded.

I'm not sure how to treat properties without type, maybe we should make them nullable as well when this feature is enabled, since null is valid value for them. For now I kept original behavior for untyped properties but I think it would be better to make them nullable by default (JoinColumn already is, just Column is not) when this feature is enabled.

@delacry
delacry force-pushed the nullability branch 4 times, most recently from 61b1134 to 80d2ee7 Compare January 30, 2025 01:16

@derrabus derrabus left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You've limited inferring nullability to attribute mapping while type inference works with any driver. Why's that?

Comment thread src/Mapping/Column.php Outdated
Comment thread src/Mapping/Column.php Outdated
@delacry

delacry commented Jan 30, 2025

Copy link
Copy Markdown
Contributor Author

You've limited inferring nullability to attribute mapping while type inference works with any driver. Why's that?

It seemed like easier option to start with, and I didn't know codebase very well yesterday, now I see that I can do it maybe in ClassMetadata.

@delacry
delacry force-pushed the nullability branch 2 times, most recently from af3f9cb to b92befd Compare January 30, 2025 16:24
@delacry

delacry commented Jan 30, 2025

Copy link
Copy Markdown
Contributor Author

I did a rewrite and now it's working for all drivers via Configuration::setInferPhpNullability, because it's saved only on ClassMetadata level, and attribute driver can access it and if it's enabled, it will set null to nullable array key, which fails isset in ClassMetadata.

Btw in next major version, this could be the default behavior.

Now I noticed I selected wrong target branch, because I noticed one bug with default referenced column name and found out it was fixed and there is already 3.4.x branch.. I'll look at it in a few hours and I will switch it.

@delacry
delacry requested a review from derrabus January 30, 2025 16:26
@delacry
delacry force-pushed the nullability branch 6 times, most recently from 23c1c5d to 1795e61 Compare January 31, 2025 15:51
@delacry
delacry changed the base branch from 3.3.x to 3.4.x January 31, 2025 15:51
@delacry

delacry commented Jan 31, 2025

Copy link
Copy Markdown
Contributor Author

I rebased it onto 3.4.x, it's ready for review, one thing I'm not sure about is to how to treat variables without type, I think it will be better to have them nullable (JoinColumn already is, but Column isn't) when using inferPhpNullability setting.

For now, I left it how it was, but it's more consistent to have them both nullable when using this setting, I don't use untyped properties so I don't mind, but it's a thing to consider and it will be difficult to change it in the future without BC break.

@derrabus

Copy link
Copy Markdown
Member

one thing I'm not sure about is to how to treat variables without type,

If there's no type, there's nothing we could infer nullability from. The old defaults are good for those cases.

@delacry

delacry commented Jan 31, 2025

Copy link
Copy Markdown
Contributor Author

one thing I'm not sure about is to how to treat variables without type,

If there's no type, there's nothing we could infer nullability from. The old defaults are good for those cases.

That's also my reasoning why I didn't added it in a first place, but then I started doubting it, since it's named as inferPhpNullability (or maybe inferPropertyNullability would be better, but longer) not type nullability (to keep those door open), so it's ok with this naming, because by PHP definition, property can be null.

I like the error-prevention of that nullability, because if DB schema is up to date with code, and no nullable is defined in attributes, there is zero chance of null related issues when loading/accessing entity data or persisting entity into the DB.

@delacry
delacry force-pushed the nullability branch 4 times, most recently from 307736e to 88d2d2d Compare February 6, 2025 18:21
@delacry

delacry commented Feb 25, 2025

Copy link
Copy Markdown
Contributor Author

I would like to prepare PR for phpstan/phpstan-doctrine, so it can read the config ang figure out how to check nullable types, but I don't know if this naming is ok, and if it gets into the 3.4 release.

@derrabus do you think I should change it from inferPhpNullability to inferPropertyNullability?

Comment thread docs/en/reference/advanced-configuration.rst Outdated
Comment thread src/Mapping/ClassMetadata.php Outdated
Comment thread src/Mapping/ClassMetadata.php Outdated
Comment thread docs/en/reference/association-mapping.rst Outdated
@github-actions github-actions Bot added the Stale label Nov 17, 2025
@delacry

delacry commented Nov 17, 2025

Copy link
Copy Markdown
Contributor Author

Hello, I would really appreciate it if someone could reply. I mentioned multiple people who know what’s going on, and I even asked about it on Slack two months ago, but I got no reply.

Because of that small BC break #12108 where $nullable became bool|null, if I revert it back to bool and add $nullableSet to indicate whether the value was passed intentionally, I would introduce even worse BC break, because if anyone is passing "null" into it, it will break.

So now I think I should keep JoinColumn attributes as they are (where $nullable is now bool|null).

But what about Doctrine\ORM\Mapping\Column? I'm handling it by adding $nullableSet property to indicate whether $nullable was set (see https://github.com/doctrine/orm/blob/7649263a91cc206d926c18ced045c832190c540c/src/Mapping/Column.php).

This way public property $nullable stays bool, should I make it same as JoinColumn where it became bool|null and cause small BC break (for consistency), or should I keep my current solution?

If no one answers by the end of the week, I'm keeping Column attribute with $nullableSet and I'll rebase my JoinColumn to current version introduced by PR I mentioned.

@delacry

delacry commented Nov 23, 2025

Copy link
Copy Markdown
Contributor Author

So I rebased it as I said and tested it in my project (works the same), failed pipeline seems unrelated (it's failed also in 3.6.x).

Could I please get a review and could you add this to 3.6 milestone? @greg0ire @beberlei @derrabus @SenseException

@greg0ire

This comment was marked as resolved.

@greg0ire
greg0ire removed their request for review November 23, 2025 18:21
@mpdude

mpdude commented Nov 29, 2025

Copy link
Copy Markdown
Contributor

I remember a lengthy discussion about this feature at the 2023 hackathon, although I fail to recall the details.

One thing I remember was that people may have a need for nullable properties to be able to bind form systems (like Symfony Forms) to entities, where fields may need to be null in code but not in DB… does that make sense?

@delacry

delacry commented Nov 29, 2025

Copy link
Copy Markdown
Contributor Author

One thing I remember was that people may have a need for nullable properties to be able to bind form systems (like Symfony Forms) to entities, where fields may need to be null in code but not in DB… does that make sense?

I'm not familiar with symfony/forms (I'm using nette/forms and manual mapping), but inherited nullability is not forced, you can always override it with nullable attribute, just default value will be same as PHP property type (if it's nullable, column will also be nullable). So that way you specify nullable in attribute only in places where for some reason you want different PHP and DB state, and you know what you are doing, because this will probably lead to error if not intended - for that form use-case it might be more typing, but it's opt-in in current state, default in 3.x will be as is.

@derrabus

derrabus commented Dec 12, 2025

Copy link
Copy Markdown
Member

I remember a lengthy discussion about this feature at the 2023 hackathon, although I fail to recall the details.

One thing I remember was that people may have a need for nullable properties to be able to bind form systems (like Symfony Forms) to entities, where fields may need to be null in code but not in DB… does that make sense?

Yes, that's basically the problem with nullability of properties. Unitil you persist it, an entity can basically represent an incomplete record. Imagine you create a new entity and then populate the properties one by one with then correct data. Symfony Forms is just one example where this is needed.

but inherited nullability is not forced, you can always override it with nullable attribute

Yeah, but this very argument can be brought up in favor of not inferring nullability. NOT NULL is not enforced, you can always override it with nullable: true. What ever default or inferring mechanism we chose, someone will complain about the default behavior.

Now, what you're proposing is a global flag that will affect all entities managed by an EM. This basically means that there's a single point of time where you can safely change this setting: When bootstrapping a new project. You cannot easily flip this switch on an existing project. You cannot iteratively switch your entities to the new way of inferring nullability. That will hurt the adoption of your feature.

You cannot use entities from external packages that have been written with the current defaults in mind. And a package that integrates with ORM by providing entities would need to test with both modes. And to be safe, such a package would need to do the one thing you want to avoid in your own codebase: Define nullability explicitly everywhere because the default might change depending on the EM's configuration.

I understand what you're trying to achieve here and that it would help you in your own project. But I believe that a global setting is the wrong way forward.

@delacry

delacry commented Dec 12, 2025

Copy link
Copy Markdown
Contributor Author

@derrabus so should I make it as a private constructor property in AttributeDriver and XmlDriver? This way it will be per-mapping and you can configure it in the mappings -> <name> -> inferNullabilityFromPHPType ORM section in symfony/nette extensions.

@delacry
delacry changed the base branch from 3.6.x to 3.7.x December 22, 2025 04:48
@delacry

delacry commented Dec 22, 2025

Copy link
Copy Markdown
Contributor Author

I see that 3.6 was released, so I changed the target, I could change also 3.6 to 3.7 in the docs I changed, but I'm pretty confident that it won't get into 3.7, since I'm usually waiting months for a reply and at the end I'll hear that people are using entities as data objects for symfony/forms as an argument against.

@derrabus

Copy link
Copy Markdown
Member

@derrabus so should I make it as a private constructor property in AttributeDriver and XmlDriver?

That would be better, but it still doesn't allow an iterative approach for switching from one mode to the other. But I don't really have a better idea. Sorry, I'd like to be more helpful. 😓

@derrabus

derrabus commented Dec 24, 2025

Copy link
Copy Markdown
Member

I see that 3.6 was released, so I changed the target

Perfect. Normally we do this ourselves, but we kinda forgot it this time. 🙈

but I'm pretty confident that it won't get into 3.7,

Maybe, we don't plan feature releases with fixed scopes.

since I'm usually waiting months for a reply and at the end I'll hear that people are using entities as data objects for symfony/forms as an argument against.

It's not an argument against your PR, it's a requirement we've had when implementing the current solution. That requirement is still valid and should not be neglected.

I understand your frustration, but please bear with us. The ORM project is not really well staffed and this change is not really our topmost priority because it replaces a solution that works for us.

@github-actions

github-actions Bot commented Apr 1, 2026

Copy link
Copy Markdown
Contributor

There hasn't been any activity on this pull request in the past 90 days, so it has been marked as stale and it will be closed automatically if no further activity occurs in the next 7 days.
If you want to continue working on it, please leave a comment.

@github-actions github-actions Bot added Stale and removed Stale labels Apr 1, 2026
@delacry

delacry commented Apr 3, 2026

Copy link
Copy Markdown
Contributor Author

Sorry for the delay, this time I was the one who went quiet for months.

Moved inferNullabilityFromPHPType from a global Configuration setting to a per-driver constructor parameter, as discussed with @derrabus. Each driver now sets the flag on ClassMetadata at the start of loadMetadataForClass(), so different mappings can use different modes.

Also prepared integration PRs for both frameworks and tested both on real apps:

@github-actions

github-actions Bot commented Jul 3, 2026

Copy link
Copy Markdown
Contributor

There hasn't been any activity on this pull request in the past 90 days, so it has been marked as stale and it will be closed automatically if no further activity occurs in the next 7 days.
If you want to continue working on it, please leave a comment.

@github-actions github-actions Bot added the Stale label Jul 3, 2026
@github-actions

Copy link
Copy Markdown
Contributor

This pull request was closed due to inactivity.

@github-actions github-actions Bot closed this Jul 10, 2026
@delacry

delacry commented Jul 10, 2026

Copy link
Copy Markdown
Contributor Author

Hello could this be reopen? If so, I could do a rebase and squash, but please could someone look at it in the next 3 months? If you don't want it just say so, so I know im not wasting my time here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[RFC] Read nullability from PHP type

6 participants