[Typescript] component prop on listitem doesn't allow you to specify component as div and button as false

[MastroLindus]

Version: 4.0.alpha5

I am aware of the work and issues around the typings for the component prop and the efforts to fix it like #13868

However the current typings seems to have some issues when trying to specify both button props and component props at the same time.
If I try to do this:

  const component = asDiv ? "div" : "li";  
const buttonProps = isButton ? { button: true } : {button: false};
<ListItem<typeof component> {...rest} {...buttonProps} component={component}>
// the rest
</ListItem>

I get:
Types of property 'button' are incompatible.
Type 'boolean' is not assignable to type 'true'.

The typings don't allow me to specify a boolean for button, but only either the literal true or the literal false

[eps1lon]

Duplicate of #14971