At about 4 weeks of age you can put a bowl of dry kitten food out for them and allow them to try to eat this too, as well they can now have a dish of water, gradually discontinue feeding milk so that by six weeks they won't need it anymore.
Bathroom
Young kittens need your help to go to the bathroom. After feeding hold them gently on their back and take a warm wet cotton ball or cloth and wipe their bottoms, to simulate a mother licking them. This will stimulate them to urinate and defecate. Be gentle and don't use so much water they are soaking. You will need to do this every time until they are moving about freely and showing an interest in the litter box. Once they reach this stage (about 3 weeks old) you should add a shallow litter box with clay, not clumping, litter. You can purchase rabbit litter boxes for this or simply cut down a small cardboard box for them to use. You can put them in the box and they will usually figure out what it is for.
Bedtime
Your kittens need to be kept in a quiet room, ideally a large cage. They should have a warm bed with edges so they are kept together for warmth. You can add a warm water bottle wrapped in a towel for extra warmth, however make sure you keep it warm as when it cools off it will draw warmth away from the kittens. You will need plenty of towels and can change them regularly as needed. A box or big litter box will work if you do not have a cage for them. If you have other pets, you must make sure they do not have access to the kittens, I strongly recommend keeping them in a room to themselves. Even when the are starting to walk around they need to be kept in a small area especially when you are not watching them. Leaving them loose in a room is asking for trouble.
Emergency Care
Once you have decided to raise these kittens do not hesitate to consult an expert if you suspect something is wrong. If a kitten is not eating for 24 hours or is weak and listless he or she, needs to see a veterinarian. Kittens are very susceptible to disease, if you have other cats who are not vaccinated take caution not to handle them prior to handling the kittens and certainly do not let them near the kittens, not only for health reasons, but sometimes other cats kill kittens.