Generic P2P Architecture, Tutorial and Example
By dzzxyz | 15 Mar 2004
Generic P2P architecture, tutorial and example that covers basic P2P strategy. Upon completing this tutorial, you will be proficient in basic P2P design and coding.
Is your email address OK? You are signed up for our newsletters but your email address has not been reconfirmed in a long time. To make this warning go away please click here to have a confirmation email sent so we can confirm your email address and continue sending you your newsletters. Alternatively, you can update your subscriptions.
This generic P2P architecture tutorial was brought to you by Planet API � Searching thousands of ASPX / ASP.NET Public Webmethods / Public Webservices, Search Engine APIs, Novelty APIs, B2B APIs, Game APIs, P2P APIs, Fun APIs, AI Chatbot APIs, etc.
Overview of P2P Culture
P2P (Peer To Peer) is when multiple computers think collectively towards a shared objective. Computer programs that use less central servers and rely on a collection of computers such as Gnutella, distributed media streaming, networks of DCC based IRC fservers etc. tend to be referred to as being more P2P. Computer programs where many end-users communicate with few central services tend to be referred to as being less P2P or not P2P. To fully understand and leverage P2P technology, one must separate his or her self from the dogma that our computer programs must be united by servers in our physical possession to synchronize activities. Rather, think of our computer programs from a more digital-life oriented perspective and break the computer software up over multiple machines and make no single part of the software critical to the collective objective.
P2P Philosophy
�Single servants are less powerful then a single server but the collective of many servants is more powerful then any single server� - Daniel Stephen Rule.
For example, a large software company gives each employee a very small amount of responsibility. Even if this means you get your month�s coding done in a few days, it is more beneficial to the company as a whole to not rely on any single employee too much and allows the company more overall stability and to ultimately write larger more complex software packages than any single person is capable of. Your software is more P2P if you leverage this same principle to achieve more bandwidth and computing speed.
Basic P2P Terminology
Peer or Servant
A computer program that acts as both a client and a server for the entire P2P network.
Connection Manager
A light server application that provides a starting point for applications which enter a P2P network. The less the connection manager is involved in the objective of your overall application, the more P2P your application is. The more P2P your application is, the less strain on your own hardware.
Simple P2P Chat Example
This example demonstrates a very simple but highly P2P application. This example consists of two fundamental P2P parts: a connection manager and a servant. The connection manager should be compiled and executed once. The servant should be compiled and its config.xml�s connectionmgr tag should be set to the IP address or domain name of the computer that is running the connection manager. Make multiple copies of the servant�s executable and config.xml and place them on multiple computers. Execute each servant on a different machine and they will contact the connection manager to resolve each other�s location and network with each other. Each servant will frequently ask the connection manager who is on the P2P network and keep their own publish list up to date. When a servant leaves the network, an updated list is published to all the other servants and they discontinue attempting to communicate with the servant who left.
Can I still try this out if I only have one computer to work with?
Yes. The connection manager assigns a new port number to each servant so each servant listens on a unique port number. You can run the servant executable as many times as you want on a single machine. For your first test, I would suggest running the connection manager once and then run the servant a couple of times on the same machine as the connection manager. Then chat in the servant windows to verify that the P2P network has been constructed on your computer. If you have other computers to work with, simply execute the servant on the other computers and chat to verify that they successfully joined the P2P network.
The configuration file:
Put the IP address of the server that has the connection manager here.
127.0.0.1
Leave this 85 unless you change the port that the connection manager sits on:
85
List the IP addresses or domain names that you wish this servant to ignore:
1.1.1.1
fooUser234.fooISP23423.com
What are the ban tags for?
The ban tags allow each servant to list the IP addresses or domain names that they do not wish to get data from.
The Connection Manager
Add a peer to the connection manager�s knowledge of the P2P network.
Collapse | Copy Code
Private Sub p2p_ConnectionRequest(Index As Integer, ByVal requestID As Long)
iPortMax = iPortMax + 1
Dim a As Integer
For a = 1 To p2p.UBound
Dim istate As Integer
istate = p2p(a).State
If istate = 0 Or istate = 8 Then
Call EnterCriticalSection(tCritSection)
RemovePeerByOffset CStr(a)
p2p(a).Close
p2p(a).Accept requestID
AddPeer p2p(a).RemoteHostIP, CStr(iPortMax), CStr(a)
Call LeaveCriticalSection(tCritSection)
Exit Sub
End If
DoEvents
Next a
DoEvents
Dim i As Integer
i = p2p.UBound
Call EnterCriticalSection(tCritSection)
Load p2p(i + 1)
p2p(i + 1).Accept requestID
AddPeer p2p(i + 1).RemoteHostIP, CStr(iPortMax), CStr(i + 1)
Call LeaveCriticalSection(tCritSection)
End Sub
A servant wants a list of all its peers.
Collapse | Copy Code
Private Sub p2p_DataArrival(Index As Integer, ByVal bytesTotal As Long)
Dim a As String
If p2p(Index).State <> 7 Then p2p(Index).Close: Exit Sub
p2p(Index).GetData a
If a = "needs peer list" Then
On Error GoTo exit_critical_list
Call EnterCriticalSection(tCritSection)
Dim pPersonalPeerDoc As MSXML2.DOMDocument
Set pPersonalPeerDoc = New MSXML2.DOMDocument
pPersonalPeerDoc.loadXML pDoc.xml
pPersonalPeerDoc.selectSingleNode("./peers/peer[offset = '" &_
Index & "']/me").Text = "TRUE"
p2p(Index).SendData pPersonalPeerDoc.xml
exit_critical_list:
On Error Resume Next
Call LeaveCriticalSection(tCritSection)
Else
MsgBox Index & " sent: " & a & " to the connection manager"
End If
End Sub
A servant left the network.
Collapse | Copy Code
Private Sub p2p_Close(Index As Integer)
Call EnterCriticalSection(tCritSection)
RemovePeerByOffset CStr(Index)
Call LeaveCriticalSection(tCritSection)
End Sub
The Servants
The connection manager has a new list of this servant�s peers.
Collapse | Copy Code
Private Sub Winsock1_DataArrival(ByVal bytesTotal As Long)
Dim document As String
If Winsock1.State <> 7 Then Winsock1.Close: Exit Sub
Winsock1.GetData document
pDoc1.loadXML document
Dim pPeerList As MSXML2.IXMLDOMNodeList
Set pPeerList = pDoc1.selectNodes("./peers/peer/port")
userList1.Clear
Dim i As Integer
For i = 0 To pPeerList.length - 1
If pPeerList(i).Text = _
pDoc1.selectSingleNode("./peers/peer[me = 'TRUE']/port").Text Then
userList1.AddItem "*" & pPeerList(i).Text
Else
userList1.AddItem pPeerList(i).Text
End If
Next
servants1(0).Close
servants1(0).LocalPort = _
CInt(pDoc1.selectSingleNode("./peers/peer[me = 'TRUE']/port").Text)
servants1(0).Listen
End Sub
This servant is connecting to all of its peers and publishing some data to all of them.
Collapse | Copy Code
Private Sub txtSend1_KeyPress(KeyAscii As Integer)
On Error Resume Next
If KeyAscii = 13 Then
iSendsLeft1 = pDoc1.selectNodes("./peers/peer").length
Dim i As Integer
For i = 0 To pDoc1.selectNodes("./peers/peer").length - 1
Dim iIp As String
Dim iPort As Integer
iIp = _
pDoc1.selectNodes("./peers/peer").Item(i).selectSingleNode("./ip").Text
iPort = _
CInt(pDoc1.selectNodes("./peers/peer").Item(i).selectSingleNode("./port").Text)
Dim strState As String
While send1.State = 6
DoEvents
Wend
send1.Close
send1.Connect iIp, iPort
Next
End If
DoEvents
End Sub
A peer of this servant wants to connect.
Collapse | Copy Code
Private Sub servants1_ConnectionRequest(Index As Integer,_
ByVal requestID As Long)
Dim remoteip As String
Dim remoteaddy As String
remoteip = servants1(Index).RemoteHostIP
remoteaddy = servants1(Index).RemoteHost
If (pConfig.selectNodes("./config/bans/ban[target = '"_
& remoteip & "']").length = 0) _
And (pConfig.selectNodes("./config/bans/ban[target = '" _
& remoteaddy & "']").length = 0) Then
Dim a As Integer
For a = 1 To servants1.UBound
If servants1(a).State = 0 Or servants1(a).State = 8 Then
Call EnterCriticalSection(tCritSection)
servants1(a).Close
servants1(a).Accept requestID
Call LeaveCriticalSection(tCritSection)
Exit Sub
End If
DoEvents
Next a
DoEvents
Call EnterCriticalSection(tCritSection)
Dim i As Integer
i = servants1.UBound
Load servants1(i + 1)
servants1(i + 1).Accept requestID
Call LeaveCriticalSection(tCritSection)
End If
End Sub
A peer of this servant has some data for it.
Collapse | Copy Code
Private Sub servants1_DataArrival(Index As Integer,_
ByVal bytesTotal As Long)
On Error Resume Next
Dim a As String
If servants1(Index).State <> 7 Then servants1(Index).Close: Exit Sub
servants1(Index).GetData a
txtChat1.Text = txtChat1.Text & vbCrLf & a
End Sub
Why don�t my P2P servants communicate with other servants on the Internet when they are behind a router?
Some routers have default communication restrictions called a �Firewall�. These restrictions are intended to prevent a virus from misusing your computer and to force you to explicitly disable them if and when you need more access to the Internet. One of the most common restrictions that harm P2P networks is when the router blocks most outgoing ports by default. You can test to see if your router is blocking a port by:
- Run a copy of the connection manager on a computer behind your router.
- On a computer outside the router on the Internet, open a DOS box and type in �telnet 85�.
- Your connection manager on the computer behind the firewall should display:
Collapse | Copy Code
ip of peer 2224 1 FALSE
If not then you need to enable port 85 in your router for the connection manager. This also has to be done for each peer behind a router with a built in firewall.
You can still leverage P2P technology on your personal network (behind your router) as long as all of your peers and your connection manager are behind your firewall. Each peer must be configured with the IP address of the connection manager that the router has assigned to it. I would highly suggest having the router assign the connection manager machine a static IP. This way, peers do not have to be reconfigured each time you reboot the box with the connection manager on it. The servants, however, can just get a dynamic IP address from your router every time they boot up because they will use the connection manager to resolve each other's location.
But I really need both servants behind routers and servants on the Internet to all be part of my P2P network.
This topic is outside the scope of this article, but in short here is one common solution used by other P2P technologies:
- Set your connection manager on a box that is intended to be a web server. If your connection manager is behind a router then configure your router to block all incoming ports but make the router forward port 85 connections to the machine that is running the connection manager.
- Have each servant report to the connection manager any peers that they are unable to contact. Have the connection manager determine if they are behind a port blocking router by seeing if the suspicious servant sends another heart beat. If most peers are complaining that they can�t connect to a suspicious servant but the suspicious servant continuously asks the connection manager for a user list then the connection manager can conclude that the servant is probably behind a port blocking router.
- If the connection manager makes this determination, have it notify the suspicious servant that it needs to pull from another peer. For the life of the suspicious servant instance, it pulls from another peer who publishes any data that it gets. The chosen peer must not itself be a suspicious peer behind a router.
This will slow the P2P network down but will allow peers behind port blocking routers to join the P2P network. I would not suggest having the connection manager just assume that a peer is suspicious instantly when the other peers complain about it, rather it should have a threshold of 2 or 3 complaints from each of the other peers before telling it that it is suspicious and assigning it a chosen peer to pull from.
License
This article has no explicit license attached to it but may contain usage terms in the article text or the download files themselves. If in doubt please contact the author via the discussion board below.
A list of licenses authors might use can be found here