Hi Michael,
Just have "rightExpression": {"value": null} on the compare condition. Here's a sample Json for entityQuery POST data, testing a null Parent of a project. You may do something similar with your field.
{
"typeName": "Project",
"fields": "Name, DueDate, Parent",
"where": {
"_type": "Compare",
"leftExpression": {
"fieldName": "Parent"
},
"operator": "Equal",
"rightExpression": {
"value": null
}
}
}