Computer Webmaster Gaming Console Graphics Forum

Welcome to the Computer Webmaster Gaming Console Graphics Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact contact us.

MK PitStop Main Earn $25 Earn Money Posting Extras Members Blogs Image Hosting User Pages
Go Back   Computer Webmaster Gaming Console Graphics Forum > Webmaster Forum > Website Coding > Database
Register FAQ/Rules Become A V.I.P. Member Search Today's Posts Mark Forums Read

Database Database problems or need to ask a question? maybe something to do with sql injections or a database software question. Database topics cover MySQL, PostgreSQL, Oracle, SQL Server or anything else related to databases.

Google
Reply
 
LinkBack Thread Tools Display Modes
Old 05-31-2007, 7:39 PM   #1
Nuno Ventura
 
Nuno Ventura's Avatar
 
Posts: n/a
My Photos: (0)

Banked:
MK Cash: $

I am Worth:
MK Cash: $
Donate

Recent Blog: None

Default backup partial tables

Hi

I have an aplication (C# ) that creates lots os records with blobs (about
1Gb/month)

I want to make a backup with the older records and delete it from the main
table.
It may be necessary to restore any old data, so I need to backup before
delete.
I decided to do this: (just the important part)

//create a new table with the same structure and name like the name_date
sqlText =" CREATE TABLE myTable_" + date + " ( Id int(6) unsigned NOT NULL
..... , PRIMARY KEY (Id)) ENGINE=MyISAM;";
cmd.CommandText=sqlText;
cmd.ExecuteNonQuery();

//read data
sqlText = "SELECT * FROM myTable WHERE date_i BETWEEN '" + dateMin + "' AND
'" + dateMax +"'";
cmd.CommandText=sqlText:
dr = cmd.ExecuteReader();
while (dr.Read())
{
id_def=Convert.ToUInt32(dr["id"].ToString());
(...)
//insert the data in the new table (have to use another command and
another connection)
sqlTextInsert="INSERT INTO myTable_" + date + " (id,...) VALUES (" +
id_def + ","+...+ "')";
cmd_insert.CommandText=sqlTextInsert;
cmd_insert.ExecuteNonQuery();
}

//Delete backuped data
sqlText =" Delete * from myTable WHERE date_i BETWEEN '" + dateMin + "' AND
'" + dateMax +"'";
cmd.CommandText=sqlText;
cmd.ExecuteNonQuery();

//copy the files for network or DVD or whatever
System.IO.File.Move(bdFolder + "\\myTable_" + date + ".MYD" ,backupFolder +
"\\myTable.MYD");
System.IO.File.Move(bdFolder + "\\myTable_" + date + ".MYI" , backupFolder +
"\\myTable.MYI");
System.IO.File.Move(bdFolder + "\\myTable_" + date + ".FRM" ,backupFolder +
"\\myTable.FRM" );

This don't work because as it reads records it uses memory and memory and it
hangs.
So I changed the program to read just 1000 records in each DataReader, but
even like that it takes about 1,5 minute for each 1.000 records and I have
about 200.000 records / month so it works, but it takes lots of time.

For me it's obvious that make one insert at a time is not a good solution,
but what to do ?
I thought in copy the intire file and the delete in each table the records
that I don't want (new ones in the backup table and old ones in the
'production' table), but I also don't like this aproach.

Any idea is welcome.
Thanks
Ventura


 
Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!Spurl this Post!Reddit!
Reply With Quote
Featured Websites
Free Space
Free Space
Free Space Free Space
Reply
Tags: , ,




Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On

Similar Threads
Thread Thread Starter Forum Replies Last Post
Is Backup on PS3 Possibly ? / Sind Backup`s auf PS3 schon möglich ? dbox Computer Consoles 1 05-30-2007 12:49 PM
Where's info on search for partial strings? (e.g., wildcards, regular expressions, ...) david.goggin@gmail.com MSN questions 0 05-28-2007 12:45 AM
CSS and tables together fireshark HTML 9 09-29-2006 1:31 PM
CSS vs Tables :P webbymonster CSS 6 07-30-2006 11:41 PM
Why don't the tables to what I want them to do! Klaas_Koopman HTML 12 07-30-2006 6:04 PM


Featured Websites




All times are GMT +1. The time now is 7:40 PM.


Powered by: vBulletin Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
LinkBacks Enabled by vBSEO 3.0.0
Cheap Computers
MK PitStop Copyright 2005 - 2008

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98