{"id":900,"date":"2007-10-03T14:54:49","date_gmt":"2007-10-03T04:54:49","guid":{"rendered":"http:\/\/www.flamingspork.com\/blog\/2007\/10\/03\/compressed-lcp-and-compressed-backup-and-switching-them-onoff-online\/"},"modified":"2009-02-21T13:44:15","modified_gmt":"2009-02-21T03:44:15","slug":"compressed-lcp-and-compressed-backup-and-switching-them-onoff-online","status":"publish","type":"post","link":"https:\/\/www.flamingspork.com\/blog\/2007\/10\/03\/compressed-lcp-and-compressed-backup-and-switching-them-onoff-online\/","title":{"rendered":"Compressed LCP and Compressed Backup (and switching them on\/off online)"},"content":{"rendered":"

Quick experiment with online changing of enabling\/disabling compressed backups and local checkpoints (LCPs).<\/p>\n

Backup is incredibly trivial and correct (even have some nodes do compressed, some not).<\/p>\n

LCPs are a bit trickier when it comes to restore… currently how the code sits is that a block using the compressed file interface in NDBFS must specify if it wants to use the compressed read\/write interface or not. So when you have LCPs that differ in compressed\/non-compressed than the current config file setting, you’re not going to be able to restore them (although setting CompressedLCP=1 should let you restore either compressed or non-compressed LCPs).<\/p>\n

At some point, I’ll probably move AsyncFile (our async file IO class) to just use azio alway, and modify azio to be transparent for non-compressed files…. I just have to fix up azio for direct io.<\/p>\n","protected":false},"excerpt":{"rendered":"

Quick experiment with online changing of enabling\/disabling compressed backups and local checkpoints (LCPs). Backup is incredibly trivial and correct (even have some nodes do compressed, some not). LCPs are a bit trickier when it comes to restore… currently how the … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[14],"tags":[117,119,628,54],"class_list":["post-900","post","type-post","status-publish","format-standard","hentry","category-mysql","tag-backup","tag-lcp","tag-mysql","tag-ndb"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p5a6n8-ew","jetpack-related-posts":[{"id":850,"url":"https:\/\/www.flamingspork.com\/blog\/2007\/06\/27\/things-that-have-recently-stalled\/","url_meta":{"origin":900,"position":0},"title":"Things that have recently stalled….","author":"Stewart Smith","date":"2007-06-27","format":false,"excerpt":"compressed backup patch actually works rather well... and restoring from compressed backup too. need to modify the rate-limiting code though... may as well rate limit the writing of the *compressed* data stream... otherwise the option isn't nearly as useful compressed LCP patch well... the *restoring* of compressed LCPs.... can write\u2026","rel":"","context":"In "life, the universe and everything"","block_context":{"text":"life, the universe and everything","link":"https:\/\/www.flamingspork.com\/blog\/category\/life-the-universe-and-everything\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":923,"url":"https:\/\/www.flamingspork.com\/blog\/2007\/11\/10\/twitter-updates-for-2007-11-10\/","url_meta":{"origin":900,"position":1},"title":"Twitter Updates for 2007-11-10","author":"Stewart Smith","date":"2007-11-10","format":false,"excerpt":"mysql-5.1.22-stew2 running my sites okay... compressed backup and LCP working fine... # f-spot isn't that quick over networked drive and wireless # Powered by Twitter Tools.","rel":"","context":"In "Twitter"","block_context":{"text":"Twitter","link":"https:\/\/www.flamingspork.com\/blog\/category\/from-twitter\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":917,"url":"https:\/\/www.flamingspork.com\/blog\/2007\/11\/09\/twitter-updates-for-2007-11-09\/","url_meta":{"origin":900,"position":2},"title":"Twitter Updates for 2007-11-09","author":"","date":"2007-11-09","format":false,"excerpt":"I can not express the hatred I have for Evolution about now # I cannot also express the utter hatred I have for the mysql mail servers # submitted compressed LCP and backup patches for review # Powered by Twitter Tools.","rel":"","context":"In "Twitter"","block_context":{"text":"Twitter","link":"https:\/\/www.flamingspork.com\/blog\/category\/from-twitter\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":904,"url":"https:\/\/www.flamingspork.com\/blog\/2007\/10\/16\/mysql-5122ish-stew1\/","url_meta":{"origin":900,"position":3},"title":"MySQL 5.1.22(ish)-stew1","author":"Stewart Smith","date":"2007-10-16","format":false,"excerpt":"I've decided to publish my patch series. The goal of the -stew patches is to collect things I find interesting and that at some point could (should) make it into the main MySQL tree (even if others don't think so). It's not designed for use in production.. I don't really\u2026","rel":"","context":"In "mysql"","block_context":{"text":"mysql","link":"https:\/\/www.flamingspork.com\/blog\/category\/work-et-al\/mysql\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":914,"url":"https:\/\/www.flamingspork.com\/blog\/2007\/11\/09\/mysql-5122-stew2\/","url_meta":{"origin":900,"position":4},"title":"mysql-5.1.22-stew2","author":"Stewart Smith","date":"2007-11-09","format":false,"excerpt":"New: Updated NDB Compressed LCP and BACKUP patches (now with O_DIRECT support) InnoDB patch for Windows that should give ~5x improvement on commits\/sec (Bug31876) Everything in current telco-6.3 tree (ndb ~6.3.5) Lots of NDB improvements and new features over regular 5.1. WL3686 Remove read before update WL2680 NDB Batched Update\u2026","rel":"","context":"In "mysql"","block_context":{"text":"mysql","link":"https:\/\/www.flamingspork.com\/blog\/category\/work-et-al\/mysql\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":854,"url":"https:\/\/www.flamingspork.com\/blog\/2007\/06\/27\/run-backup-run\/","url_meta":{"origin":900,"position":5},"title":"Run Backup, Run!","author":"Stewart Smith","date":"2007-06-27","format":false,"excerpt":"Over the past N weeks\/couple of months, we've been making a number of improvements to how backups are done in MySQL Cluster. Once you get to large data sets, you start to really care about how long a backup takes. Traditionally, MySQL Cluster has been in-memory only. The way to\u2026","rel":"","context":"In "mysql"","block_context":{"text":"mysql","link":"https:\/\/www.flamingspork.com\/blog\/category\/work-et-al\/mysql\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]}],"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/www.flamingspork.com\/blog\/wp-json\/wp\/v2\/posts\/900","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.flamingspork.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.flamingspork.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.flamingspork.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.flamingspork.com\/blog\/wp-json\/wp\/v2\/comments?post=900"}],"version-history":[{"count":1,"href":"https:\/\/www.flamingspork.com\/blog\/wp-json\/wp\/v2\/posts\/900\/revisions"}],"predecessor-version":[{"id":1493,"href":"https:\/\/www.flamingspork.com\/blog\/wp-json\/wp\/v2\/posts\/900\/revisions\/1493"}],"wp:attachment":[{"href":"https:\/\/www.flamingspork.com\/blog\/wp-json\/wp\/v2\/media?parent=900"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.flamingspork.com\/blog\/wp-json\/wp\/v2\/categories?post=900"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.flamingspork.com\/blog\/wp-json\/wp\/v2\/tags?post=900"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}