So sorry, I should’ve RTFM …
http://svnbook.red-bean.com/en/1.5/svn.ref.svn.c.add.html
You can add a directory without adding its contents:
$ svn add --depth=empty otherdir A otherdir
Edit: This doesn’t work recursively though, is there any way to do that too?