Are you letting it rise the time that it requires? Plus one thing that I do, is I always add my sugar, yeast and warm water together first, then I’ll let it set for a minute or two before I add anything else. The salt will kill the yeast if added to soon.
I do this all of my yeast breads. It really does make a difference. Might try it that way.