Once you get to a certain mission with Father or the Brotherhood of Steel, it will bring up an alert saying that continuing will make you permanent enemies with said faction.