It depends. Here's my take on it:

“It isn't good” < - Expression/Adjective

“It's not me” < - Noun

But it can also vary based on the conversation.

“This is my red car”

“It's not red, though” < - Expressing confusion

But use whatever you want, it doesn't matter.