Giving me grief

Cause someone unwanted annoyances or problems

He was giving me grief about missing work.