Absolutely not
You need the torque on the axle stub to keep everything in place. You take it off and you'll watch your wheel pass you on the freeway
Why not replace the bearing? They're pretty easy.
Drain the front diff, disconnect the 4wd actuator, loosen the diff mounts where the attach to the frame to give you some free play, drop the axle, remove the bolts securing the extension to the torque arm. Undo the bolt securing the housing extension, pop it out.
Undo the circlip holding the output shaft in place, pop it out. Mind the order in which the various shims and engagement dogs come out. Now is a good time to clean up your mating surfaces.
From there, grab a micrometer and measure the seat height of the bearing, it doesn't have a lip it rests against, so you'll need to take some measurements to put it back in the same spot. Take a (24mm, I think?) socket on a long extension and drive out the bearing and seal from the opposite side. Drive the new bearing in to the same depth, install the seal. Put a dab of wheel bearing grease on your finger and prelube the bearing and seal.
Installation is reverse of removal. Housing extension and housing are sealed with some RTV. Plop it back together, go have a beer while the RTV dries, fill the diff up, take a few hard left turns to get oil to the bearing, and you're done. It's about a 4 hour job, labor being 1.5 hours, half of which is fussing with the circlip to remove the output shaft. The rest of the time is waiting for the RTV to dry enough that you can refill the diff