You can also buy Bitcoin outside a secure exchange through specialized Bitcoin ATMs and peer-to-peer (P2P) transactions. However, Bitcoin ATMs are not always easily accessible (depending on your region). But if you do use one, be prepared for high transaction fees within the 10% range.
P2P exchanges may be convenient but take it with a grain of salt as they are often less secure due to direct buyer-seller contact and also more expensive compared to regulated exchanges like Fasset.