A way is using some firewall like ipchains or iptables. and write a line like
ipchains -A input -s whatever.youwant.block.ip address -p tcp 23 -d 0/0 -j DENY