Deubiquitinating enzymes are essential to the ubiquitin (Ub)/26S proteasome system where they release Ub monomers from the primary translation products of poly-Ub and Ub extension genes, recycle Ubs from polyubiquitinated proteins, and reverse the effects of ubiquitination by releasing bound Ubs from individual targets. The Ub-specific proteases (UBPs) are one large family of deubiquitinating enzymes that bear signature cysteine and histidine motifs. Here, we genetically characterize a UBP subfamily in Arabidopsis (Arabidopsis thaliana) encoded by paralogous UBP3 and UBP4 genes. Whereas homozygous ubp3 and ubp4 single mutants do not display obvious phenotypic abnormalities, double-homozygous mutant individuals could not be created due to a defect in pollen development and/or transmission. This pollen defect was rescued with a transgene encoding wild-type UBP3 or UBP4, but not with a transgene encoding an active-site mutant of UBP3, indicating that deubiquitination activity of UBP3/UBP4 is required. Nuclear DNA staining revealed that ubp3 ubp4 pollen often fail to undergo mitosis II, which generates the two sperm cells needed for double fertilization. Substantial changes in vacuolar morphology were also evident in mutant grains at the time of pollen dehiscence, suggesting defects in vacuole and endomembrane organization. Even though some ubp3 ubp4 pollen could germinate in vitro, they failed to fertilize wild-type ovules even in the absence of competing wild-type pollen. These studies provide additional evidence that the Ub/26S proteasome system is important for male gametogenesis in plants and suggest that deubiquitination of one or more targets by UBP3/UBP4 is critical for the development of functional pollen.