Can You Start A Sentence With But?

Can you start a sentence with but? :- Throughout our school life, it has been taught to us that starting the sentence with conjunctions like “And” or “But” is unacceptable….