It's hard to figure out how many calories it counts for, and it may vary widely depending on the exact type of fiber, your intestinal fauna, and how long you've been consuming that fiber (giving your fauna a chance to adapt.)
Two things to note:
1. The calorie count TO YOU is far lower than the total calorie count. Having bacteria digest fiber and then having you digest bacteria is not as effecient a process as having you digest sugar.
2. The carb count TO YOU is zero. The bacteria digest the carbs in the fiber. When you digest the bacteria, you're digesting a fiber-less carb-less animal product.