Potentially yes. You'd be bringing yourself to the attention of malefic energies or entities, and unless you had the skills to drive them off, they might make life difficult for you.