I tried the following:
$one = OneModel::findOrFail($id);
$two = $one->two_model()->findOrFail($two_id);
$two->delete();
But that deletes the record from the database, how can I just remove the relationship without deleting from the table? And also not having to mess with the pivot table, because if that is needed, why am I even using a framework...