gh-143930: Tweak the exception message and increase test coverage

gh-143930: Tweak the exception message and increase test coverage #248277