YES, this is something you should get checked out immediately. You may have a ball joint binding up, and failure to get it address could manifest itself in sudden total loss of control and a serious accident. It could even come apart on the highway, and you cannot imagine the accident you’ll be involved in.
DO NOT continue to drive this vehicle until you get this checked out. Have it towed to your shop. The risk is too great.