Cross server file transfer possibility- winserver2008 ?

Guys, I am new to this. Thus, really need your expert advice.

I want to transfer file from C:/inetpub/vhosts/domain.com/subfolderA from Server 1 in location A

into

E:/inetpub/vhosts/domain.com of server 2 in location B (not in the same network)

automatically.

Both are win server 2008.

How possible izzit?

Use vbscript call to copy all files/folders is definitely not a problem.

But how about transfer of files/folders from server 1 to server 2 in a remote location?

Zip it first? Shell? FTP? Security of the files when being move to remote location?

Any example scripts or similar reference? in vbscript or php.

From serverfault i need help

• Use whatever you are familiar to.

  People normally are using rsync.

  From Andrejs Cainikovs

• Rsync is good, however an alternative would be to use Secure FTP:

  http://www.cuteftp.com/

  Which you can script via a GUI

  i need help : seems to be a good one, but its not free version.

  i need help : thanks, your secure ftp lead me to google around this keyword, and finally found my own solution, which is vbscript to invoke winscp dos command line for file transfer. thanks again!
  From Phil Hannent

• I just tried with WinSCP command prompt.

  The transfer from local win xp to remote win2008 server works fine.

  But when transfer directly from remote server to remote server, it fail at the command= put stage.

  The ms dos keep on hanging after I issue a command to upload files from the original remote server to the destination remote server.

  Guys, any idea?

  i need help : ok, fixed. It hang there due to windows firewall doesn't allow program full features to be invoked. after I add winscp into firewall exception, it work fabulously.
  From i need help

File locks on an NFS?

Hi,

My server uses NFS (Network File System), and I'm unable to use PHP's flock() -function. Is there a way to lock files on an NFS or is there a need to do so?

From serverfault Tower

• flock() works just fine on Linux NFS, including from PHP. We use it extensively and have tested it thoroughly to verify it's working as desired. Check to see if you're running all of the necessary services on both the client and server. Look for "portmapper" and "rpc.statd". If they're not running, you need to figure out which init script starts them on your distro. On Debian-based distros it's "/etc/init.d/portmap" and "/etc/init.d/nfs-common".

  From the client, run "rpcinfo -u $NFSSERVER status" and see if you get a response. On my setup, I get "program 100024 version 1 ready and waiting" as the result.

  Oh, also bear in mind that in some circumstances NFS and statd can get upset if both the client and the server don't have reliable hostname entries for each other. Double check /etc/hosts on both machines.

  Tower : I'm not really in a position to alter server specific details. The flock() -function is even disabled from the php.ini, because it would not work, at least that's what I've been told to.
  From Insyte

• Just wanted to answer to myself. The solution can be found here: http://us3.php.net/manual/en/function.flock.php#82521

  Insyte : The second option listed is exactly what I describe: using the built-in lock server in Linux NFS. The troubleshooting steps were designed to determine why it (apparently) wasn't working...
  From Tower

• I don't know how the PHP flock() function is implemented, but assuming it's an interface to the flock() syscall, then it does not work at all over NFS. From the flock() manpage:

  flock(2) does not lock files over NFS. Use fcntl(2) instead: that does work over NFS, given a sufficiently recent version of Linux and a server which supports locking.

  From janneb

Ubuntu issues with IP

I'm having a really odd issue where ifconfig and my /etc/network/interfaces disagree. I have /etc/network/interfaces configured so eth0 has a static IP of 192.168.2.5; however, ifconfig says eth0's IP is 192.168.2.198 (in my DHCP range). As far of the rest of my network is concerned, the machine is located at 192.168.2.198 . I've tried restarting networking (/etc/init.d/networking restart) twice now, and that didn't resolve the issue.

/etc/network/interfaces

auto lo
iface lo inet loopback

iface ppp0 inet ppp
provider ppp0

auto ppp0

iface eth0 inet static
address 192.168.2.5
netmask 255.255.255.0
gateway 192.168.2.1

ifconfig

eth0  Link encap:Ethernet  HWaddr 00:19:b9:6d:a2:b1
      inet addr:192.168.2.198  Bcast:192.168.2.255  Mask:255.255.255.0
      inet6 addr: fe80::219:b9ff:fe6d:a2b1/64 Scope:Link
      UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
      RX packets:301767 errors:0 dropped:0 overruns:0 frame:0
      TX packets:76931 errors:0 dropped:0 overruns:0 carrier:0
      collisions:0 txqueuelen:1000
      RX bytes:153435880 (146.3 MB)  TX bytes:9934052 (9.4 MB)
      Interrupt:22

lo    Link encap:Local Loopback
      inet addr:127.0.0.1  Mask:255.0.0.0
      inet6 addr: ::1/128 Scope:Host
      UP LOOPBACK RUNNING  MTU:16436  Metric:1
      RX packets:23150 errors:0 dropped:0 overruns:0 frame:0
      TX packets:23150 errors:0 dropped:0 overruns:0 carrier:0
      collisions:0 txqueuelen:0
      RX bytes:9998881 (9.5 MB)  TX bytes:9998881 (9.5 MB)

wlan0 Link encap:Ethernet  HWaddr 00:19:7e:60:e7:b5
      UP BROADCAST MULTICAST  MTU:1500  Metric:1
      RX packets:0 errors:0 dropped:0 overruns:0 frame:0
      TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
      collisions:0 txqueuelen:1000
      RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)
      Interrupt:16 Memory:ecffc000-ed000000

From serverfault Shadow

• can you post the output of:

  cat /etc/network/interfaces
  

  and

  ifconfig
  

  edit: oops, I missed one:

  nm-tool
  

  I'm betting that NetworkManager is why your interface is pulling DHCP. Check Preferences > Network Connections.

  Shadow : See edits......
  From Greeblesnort

• Below is my /etc/network/interfaces file for a static IP running Ubuntu:

  # The loopback network interface
  auto lo
  iface lo inet loopback
  
  # The primary network interface
  auto eth0
  iface eth0 inet static
  address 10.10.100.17
  netmask 255.255.255.0
  network 10.10.100.0
  broadcast 10.10.100.255
  gateway 10.10.100.1
  

  Can you confirm that you are intentionally using the point to point protocol? Also, are you wanting PPP or PPPoE? If you are needing to use PPP, would the following work?

  auto lo
  iface lo inet loopback
  
  iface ppp0 inet ppp
        provider myisp
  
  auto eth0
  iface eth0 inet static
  address 192.168.2.5
  netmask 255.255.255.0
  broadcast 192.168.2.255
  gateway 192.168.2.1
  

  In the above, you'll need to replace myisp with your specific isp info. Also, if you are using PPP, could you post the output of:

  cat /etc/ppp/options   # or any other interesting files in this directory
  cat ~/.ppprc
  

  Shadow : I'm pretty sure the ppp interface was there since I installed the OS.
  From Matthew Rankin

• You don't have eth0 flagged as "auto" in /etc/network/interfaces. This means restarting networking is going to ignore that interface and it will just keep whatever config it already had (apparently a DHCP assigned address).

  Try this:

  1. Run "ifconfig eth0 0 down"
  2. Edit /etc/network/interfaces and add auto eth0 above the definition of the eth0 interface.
  3. Run "ifup eth0". It should come up with the address you assigned in /etc/network/interfaces.

  You may also want to check your process table for an instance of dhclient. If it's there, kill it.

  Shadow : Thanks! That fixed it.
  From Insyte

Adding a second IP to Debian Server

I was given a second IP by my server provider. I am running Debian 5.0. I thought I knew how to add the IP to the system and configure with apache, but I have not yet been able to.

The primary IP works fine and I have a few sites already running on that one.

What steps would I take to add this second IP so that I use it in apache?

From serverfault David

• You are supposed to configure a new alias for your second ip.

  The mandatory resources for ip management are the file /etc/network/interfaces and the ip tool from iproute package.

  Where are things breaking? what doesn't work?

  From scyldinga

• Assuming the new IP address is on the same subnet as the first, add a second virtual interface (sometimes called an "alias") to the primary network interface. This is configured, like all network interface settings, in /etc/network/interfaces. The Debian Reference manual has a section on the topic:

  http://www.debian.org/doc/manuals/debian-reference/ch05.en.html#%5Fthe%5Fvirtual%5Finterface

  A simple example, assuming your primary network interface is eth0 and has an ip of 192.168.1.1 and the new ip is 192.168.1.2:

  auto eth0
  iface eth0 inet static
    address 192.168.1.1
    netmask 255.255.255.0
    gateway 192.168.1.254
  
  auto eth0:0
  iface eth0:0 inet static
    address 192.168.1.2
    netmask 255.255.255.0
  

  Once the appropriate settings have been added to /etc/network/interfaces, run ifup eth0:0 to activate the new interface.

  If, however, the new ip is on a different subnet, you need to either provision the ip on a physically distinct network interface or create a VLAN interface, depending on how your ISP is prepared to hand it off to you. That's a whole new topic.

  David : Thanks for the answer. I tried following these instructions, but when I restart the network interfaces I receive this error: :/etc# /etc/init.d/networking restart Reconfiguring network interfaces...SIOCDELRT: No such process if-up.d/mountnfs[eth0]: waiting for interface eth0:0 before doing NFS mounts (warning). done. The subnet is the same for the ips, so from what I know and read this above solution should work. The virtual host that I setup are not working and I get network timeout on the domain.

  Insyte : The warnings sound reasonable. The fact that it makes reference to waiting for eth0:0 is good news. What do your network interfaces look like after restarting networking? Specifically, what does the output of "`ifconfig -a`" look like?
  From Insyte

• If you use the iproute package, you can put this in /etc/network/interfaces:

  auto eth0
  iface eth0 inet static
      address 10.0.0.17
      netmask 255.0.0.0
      gateway 10.0.0.1
      up   ip addr add 10.0.0.18 dev eth0
      down ip addr del 10.0.0.18 dev eth0
  

  From hop

• Even Simpler:

  Use an "addresses" line in /etc/network/interfaces

  iface eth1 inet static
          address 10.10.0.66
          netmask 255.255.255.240
          network 10.10.0.64
          broadcast 10.10.0.79
          gateway 10.10.0.65
          addresses 10.10.0.67/28 10.10.0.67/28 10.10.0.68/28
  

  You can use a space seperated list of IPs/CIDR netmasks.

  This is a crippled version of my interface definition (IPs changed and only relevant part)

  From $pageUsers[$post.author].name

MySQL performance over a (local) network much slower than I would expect

MySQL queries in my production environment are taking much longer than I would expect them too. The site in question is a fairly large Drupal site, with many modules installed. The webserver (Nginx) and database server (mysql) are hosted on separated machines, connected by a 100mbps LAN connection (hosted by Rackspace).

I have the exact same site running on my laptop for development. Obviously, on my laptop, the webserver and database server are on the same box.

Here are the results of my database query times:

---

Production:

Executed 291 queries in 320.33 milliseconds. (homepage)

Executed 517 queries in 999.81 milliseconds. (content page)

Development:

Executed 316 queries in 46.28 milliseconds. (homepage)

Executed 586 queries in 79.09 milliseconds. (content page)

---

As can clearly be seen from these results, the time involved with querying the MySQL database is much shorter on my laptop, where the MySQL server is running on the same database as the web server.

Why is this?!

One factor must be the network latency. On average, a round trip from from the webserver to the database server takes 0.16ms (shown by ping). That must be added to every singe MySQL query. So, taking the content page example above, where there are 517 queries executed. Network latency alone will add 82ms to the total query time. However, that doesn't account for the difference I am seeing (79ms on my laptop vs 999ms on the production boxes).

What other factors should I be looking at? I had thought about upgrading the NIC to a gigabit connection, but clearly there is something else involved.

I have run the MySQL performance tuning script from http://www.day32.com/MySQL/ and it tells me that my database server is configured well (better than my laptop apparently). The only problem reported is "Of 4394 temp tables, 48% were created on disk". This is true in both environments and in the production environment I have even tried increasing max_heap_table_size and Current tmp_table_size to 1GB, with no change (I think this is because I have some BLOB and TEXT columns).

From serverfault

• Do you have query caching enabled? Look at the output of:

  SHOW VARIABLES LIKE 'query_cache_size';
  

  If it's greater than zero, it's on. This will make quite a difference to the performance of a website backed by MySQL, though I'm not sure if it's anything to do with your specific issue here.

  I don't suppose there's any way to capture the set of queries and run them from a login on the MySQL database server, to see whether things are different there?

  Another possible issue is that if you're not doing session caching, you're opening a new session every time you make a database call. Do you know if you're session caching? Opening a new session for every call can get expensive across the network.

  : Yes, I have the query cache enabled in both production and development environments. Production : 134217728 Development: 16777216 I'm pretty sure that session caching must be being used, though I don't know how to test. I can not imagine that Drupal opens a new database connection for every query!
  From Morven

• The only problem reported is "Of 4394 temp tables, 48% were created on disk". This is true in both environments and in the production environment I have even tried increasing max_heap_table_size and Current tmp_table_size to 1GB, with no change (I think this is because I have some BLOB and TEXT columns).

  You can put MySQLs tmpdir on a RAM-based filesys (e.g. tmpfs) to help improve performance.

  Cheers

  P.S.

  Maybe the performance hit is RAID writes in Production.

  : sure, but that still doesn't explain the difference between the two setups, which both have that problem.
  From Jason

• What I would do to identify where the bottleneck is: I would do a profiling of the query: http://dev.mysql.com/doc/refman/5.0/en/show-profiles.html

  If the numbers are way lower than what you can see from the same query you run on your web server, then it is a "transport" issue. (Rackspace network latency, switch config, large sets of data (SELECT *) with TEXT/BLOB fields returned, etc.)

  If the numbers are almost similar, you have to optimize your queries and improve your config file. Here is a link that may help: http://stackoverflow.com/questions/1191067/how-to-test-mysql-query-speed-with-less-inconsistencies/1191506#1191506

  BTW, when my server went from 100Mbs to 1Gb, the performance increase was amazing!

  : I tried profiling some queries in this way. It turns out that queries run from the production web server or database server take about the same amount of time to run. The same queries run on my laptop actually run slower than in production!

  : Although, what I was comparing there was possibly what you were getting at - I logged into MySQL on the web server and on the database server, ran the queries on both, and compared the profile data. Is that right? Or, do you mean to compare the query time reported by MySQl profiles (which wouldn't include any network latency) with that that is reported by drupal (which would include network latency)?

  Toto : Good point: you could run some queries from the web server and then directly from the database. The difference would be the "transport" time. Re-reading your question, I noticed that each page can generate +500 queries?! This is way to much. You definitively have to cache data (Memecache, html cache, etc.) to reduce the number of queries. Do not forget that PHP executes requests one after the other (In a same script)... Which means that you have too much communication between your 2 servers and it takes time. :(
  From Toto

• The TCP connection setup and tear down is much more costly than the socket connection when working on localhost. Check how many connections to the database are initiated in a page load.

  : Max connections is set to 100. Max used connections shows consistently as 28. I think this number must relate to the 38 fcgi processes I have somehow. Only one connection is created per page load - that is how drupal works.
  From Craig

• It's really hard to give you a definite answer. I really don't think the network is the bottleneck, well, unless you have some really heavy traffic on the server.

  Do you have the same exact configuration on both your development machine and the production server?

  Are you sure that all indexes were created successfully on the production server?

  It could the amount of data in your production server. I mean to compare the results between the production and development machines you should have the same number of rows in the tables, is this the case?

  Did you use the same installation files to setup MySQL on your development machine and production server? I mean do you have the same version of MySQL on both your development and production machines? Is it for the same OS? Also 32bit or 64bit? Probably a bug in the version of MySQL installed on the server.

  The possibilities are endless, without more details it will be really hard to give you an informative answer.

  : Network traffic between web and database servers isn't high at all. MySQL communication is happening on a dedicated interface, and the load on it is well within it's bounds. MySQL configuration on production and development machines is different (I'll update the main thread with the details in a minute). The two databases are identical, with the same amount of data in each (I regularly re-sync them). The production machine is using MySQL 5.0.45 x86_64. Development is using 5.0.75 x86_64.
  From

How to redirect subdomain to domain with subdomain as parameter

I would like to redirect my wildcard subdomain to my main domain using the subdomain as a GET parameter in the URL using .htaccess

Example of what I would like to happen:

billy.example.com

redirects to

www.example.com/profile?user_name=billy

Here is the current rule I have put together based on other answers on this site. However, when the redirect happens I get the following URL with a "Redirect Loop" error:

www.example.com/profile?user_name=www

RewriteCond %{HTTP_HOST} ^(.*).example.com
RewriteRule ^(.*)$ http://www.example.com/shop?user_name=%1 [R,L]

I've seen this answered a few different ways on this website but unfortunately none of them worked for me. Any help would be appreciated. Thank you

Details: I'm using PHP, and i have setup * as a subdomain in my hosting panel.

From serverfault justinl

• After trying to solve this using .htaccess and failing, I ended up using PHP to do the URL parsing for me. For those who wish to see what I did:

  $host = $_SERVER['HTTP_HOST'];
  $subdomain = str_replace('.example.com', '', $host);
  if($subdomain != 'www')
      header("Location: http://www.example.com/shop?user_name=".$subdomain);
  

  From justinl

• Your redirect loop is happening because you are redirecting everything (even www.example.com). Maybe try something like:

  RewriteCond %{HTTP_HOST} !^www\.example\.com$ [NC]
  RewriteCond %{HTTP_HOST} ^([^\.]+)\.example\.com$ [NC]
  RewriteRule ^/(.*)$ http://www.example.com/shop?user=%1 [L,R=301]
  

  This should only fire when you're on something other than www.example.com.

  justinl : Hi Seth. I tried that code you gave me but it doesn't appear to redirect the page. When I enter username.example.com it just stays on the main homepage and the URL says username.example.com.
  From Seth

• Does this do a lot of damage to the system performance compared to usual GET parameter already in the URL?

  From gary

sql server 2005 Replication

Hi friends,

We have a sql server 2005 which contains 4 to 5 databases which are updated everyday externally, Currently we are backing up the Database and attaching to a different server and working on it in order to make sure nothing is deleted or changed in the original database.

But This backup and restore process has become hassle so i have looked up couple of options like replcation services but i dont seem to have Replication components installed i tried to install them but i could only see Subcription services not the publisher servcies any ways we use sql server 2005 express edition is replication the best bet or do u suggest any other ways?

If so how do we get the replication components? And if not what are the other ways ?

Thanks in Advance

From serverfault $pageUsers[$entry.posts[0].author].name

• You might want to check out this article at databasejournal.com. Of particular note is this paragraph:

  You should keep in mind that replication functionality is not incorporated by default in the SQL Server 2005 Express Edition installation. The option controlling this behavior is accessible by expanding the Database Services node on the Feature Selection page of the setup wizard and can be modified by assigning "Will be installed on local hard drive" value to its Replication entry. In addition, if you intend to take advantage of the connectivity and Replication Management Objects (RMO), you should apply the same setting to the Connectivity Components subnode of the Clients Components node on the same page of the wizard. In case you missed these steps during initial setup, simply launch SQLEXPR32.EXE (or SQLEXPR.EXE for 64-bit systems) to modify an existing instance (for the background information regarding this process, refer to our earlier article).

  From C-Pound Guru

• Replication would really be like shooting a fly with an elephant gun.

  Why not just restore your database with a different name? For instance, you could have "MyProductionDB" and "MyTestDB". Then script out the backup and restore, and you need only run the script when you want to "refresh" the test instance (note that there is a "Generate Script" button at the top of the backup and restore dialogs).

  Alternatively, do the same scripted backup/restore, but create a test instance if you can't change tha database name. The test instance could even be on the same physical machine - MyComputer\SQLExpress and MyComputer\SQLExpressTest.

  Aaron Alton : RESTORE DATABASE in Books Online: http://msdn.microsoft.com/en-us/library/ms186858.aspx (Were you looking for something more specific?)
  From Aaron Alton

• Replication services on publisher's side are not available with SQL Express. This is a licensing issue. Sql Express allows you only to subscribe to an existing publication.

  Instead of replication, you could decide to set a scheduled backup job. As job management is not available in sql express (and I guess you don't want to pay for the full Sql Server license), you can find third party software that will allow you to manage such tasks. I guess you should google for 'sql express job scheduler' or similar request.

  From $pageUsers[$post.author].name

• Replication may be overkill here, since it's designed more for continuous transfer of data than just a working backup copy. Obviously there are periodic replication methods (snapshot), but I still think it's more than you need for what you're trying to do.

  If both database instances are on the same server (or have visibility to a common network location), then you can just schedule a daily backup on the first and a daily restore 30 minutes later on the second one (or whatever delay is feasible). This way, it happens automatically.

  I just set up a more complicated process, in case you don't have a common network location. A batch file on the source creates a backup through OSQL, then zips it and uses an FTP script to send it across the internet. Another script on our destination sees the file in the FTP receive folder, extracts it, and then restores it using OSQL, sending an email notification when it's done. Definitely more complicated, but also an option if you need the flexibility.

  From rwmnau