The chasid, differently from the tzaddik, will separate himself even from luxuries which are allowed. Why would he impose more stringencies on himself? Get to know your yetzer hara so that you can set boundaries for yourself to prevent falling into sin.