Constrained optimization problems are prevalent in all areas of science and engineering, and many well-known numerical methods have been developed to solve these problems. Yet, when there exists random quantities in the model under consideration, most of the deterministic methods are no longer effective. In this dissertation, we address parameter...