True, but it doesn't necessarily lead anywhere. Otherwise, you would not have the concept that faith without works is dead. St. Augustine had a conscience, but he kept praying, "Make me pure -- but not yet."

One of the essential parts of penitence is the intention to undo what wrong one has done to whatever extent may be possible, or to make reparations to whatever extent is possible.