You are his young mom (35years old) . He hated when you picked him up because people would see that you looked more like his sister than his mom and they'd ask him questions. He didn't want you to be reminded of why his dad left also, it would hurt your feelings.