Swallow a grapefruit

Today I was talking to a religious leader and he said to me, "You look like you're going to swallow a grapefruit. What was he inferring?