Jiuxian.com: Let's listen to cloud APM to create high-available wine e-commerce

The low-key Jiuxian network technical team In the past, the technical team of Jiuxian.com was very low-key in the entire DevOps circle. In their own words, they adhered to the concept of “ simple and sincere, people- oriented ” in Shanxi Jinshang culture , as a technical person or a pragmatic Low-key, the first priority is to do a good job of technical ability, do a good job in the vertical e-commerce of wine, and reflect the value of the industry. Moreover, although the development of Jiuxian.com has shown very rapid growth in the past three or four years, in fact, the underlying architecture and startup companies are not much different. The pursuit of more efficiency and growth rate is not handled in big data. Usability and stability are particularly energetic. As the situation changed, Jiuxian.com gradually moved to the wine unicorn company. The CTO of Jiuxian.com once said that as a company that relies on retail sales to value, although the PE index is very low, as a technical person, I hope to increase the weight of the company's valuation from the technical content. I hope that the entire system of Jiuxian is now. Increase the technology and Internet genes to attract more talents to join. Moreover, with the continuous increase of website traffic, Jiuxian has also begun to make new attempts and explorations in the selection of technology and some small technical fields. In the follow-up, I hope that Jiuxian.com will have more voices in the whole Internet or in the e-commerce field. Whether it is the open source community or the development of the entire Internet technology, it can contribute to the power of the Jiuxian technicians. Alternative vertical e-commerce

of

Jiuxian.com's overall structure of liquor e-commerce has a cyclical and seasonal characteristics. Brewmaster network of UV on the order of hundreds of thousands, the festival atmosphere is very clear, unlike most of the electricity supplier, such as Jingdong at 618, two-eleven, when traffic will upgrade 67 times. During festivals, such as Mid-Autumn Festival, Double Eleven, and Spring Festival, even if any marketing activities are not done and the price is raised more than usual, the website traffic is ten times more than usual. Under normal circumstances, the double eleven of Jiuxian.com will turn over 100 times more than usual , and the test of technology is huge. This determines that 100 times of flow and 35 times of flow are completely different in technical play. This situation is closely related to the characteristics of alcohol e-commerce. The offline market for alcohol is worth tens of billions, but the online e-commerce is actually on the scale of tens of billions. Then there are actually 890 billion market sizes that are online. This shows that if 1% of people want to go offline, then the entire e-commerce platform in the country has doubled. This space is really very imaginative. Therefore, Jiuxian.com is also doing a new exploration on the model, how to transfer the Liangtian that can be developed offline. What are the technical challenges of high concurrent high traffic? 1. How to realize the design and landing of system stability and controllability under the peak of hundreds of times of traffic, to ensure the maximum utilization of server resources? For example, whether to do virtual or all work. If the flow of more than 100 times is down, the server is definitely surplus, so the idea of ​​exploring a hybrid cloud is to deal with this problem. In general, in most e-commerce companies, the concept of hybrid cloud is still relatively small. But for Jiuxian.com, it is necessary to take this step. 2. For Jiuxian.com, it is a complex business model. At the back end, there is a warehouse system and a supply chain system. This will open up all 2C end 2B terminals, open up the upstream and downstream, the entire supply chain, sales forecasting system, warehousing functions, and the entire data operation system. For example, the same wine, scattered in different sales channels, then how much pricing, sales, purchases, how to distribute each warehouse must be considered. At the same time, wine has a regional and seasonal, how to intelligently distribute, this is a great challenge for Jiuxian. 3 , Jiuxian.com is very concerned about the user experience. I bought it in Jiuxian. I know that it is beautifully packaged and the cost is high. In this way, the proportion of packaging costs is also very high, probably accounting for 7-8 points. This is unimaginable in the entire retail category. Whether it's from foam, tape, air bubbles, or paper trays, it's the best choice. On the other hand, if it is technically implemented, the speed of the page opening, the stability of the system, the usability, the quality of the CD N , and some information leakage and traffic hijacking that we are facing now are very important from the perspective of the company. . How does an alternative vertical e-commerce deal with the challenge? 1 “ Five-level, four-service ” support system architecture The system structure of Jiuxian.com is an SOA -oriented architecture. The purpose of using this system is to meet the needs of business development and ensure expansion. The overall framework is supported by four services: “ cache ”, “ index ”, “ message ” and “ log ” , and adopts a multi-tier hierarchical service architecture. 1Web application and APP application, mainly for the consumer level, is the presentation layer, which can be divided into different business subsystems according to business and function. This is very special in the e-commerce industry website. Like this layer, it includes ERP , the official website of the consumer and the mobile website. On the official website, Jiuxian.com will be divided into sub-business modules for expansion. Generally, it is an independent deployment, which effectively increases the performance expansion after independent deployment. This layer is a static file, and Jiuxian.com is deployed independently. Generally speaking , when CDN is used, dynamic files are inconvenient on CDN . Static files are CDNs on a perennial basis . 2 cache. Jiuxian.com has a level 1 cache and a level 2 cache. The first-level cache mainly reduces the data interaction between the presentation layer and the service layer, so that the wine network effectively increases the transmission efficiency and reduces the calculation pressure of the service layer. Each cache level has a separate switch for debugging and error correction. 3 service layer, the service layer is also divided according to different functions and business subsystems. There is no mutual call between the general business subsystems, but the sub-functions of the Jiuxian network are called each other and are in the form of cross-calls. The service layer directly interacts with the web application presentation layer, and this layer does not deal with the database. The service layer is also deployed independently according to different subsystems and services, which is conducive to the pressure of competition. It will be more convenient at the expansion level. 4 second level cache. The upper level already has a level 1 cache. The following level cache provides data interaction for the web interface . The web interface does not go through the level 1 cache, and directly goes to the service layer to perform data transmission outside, in order to reduce the pressure on the database. The second level cache is the same in nature as the level one cache, except that it plays a different role in the process. 5 database. According to different functions, Jiuxian.com is divided into different physical genes for deployment. The database is in the form of separation between the master and the slave, and the master and the slave interact with each other to perform data synchronization. Because it is divided into different physical genes, Jiuxian.com has formed a multi-master and multi-conformity agreement. 2. How to deal with complex data flow problems? The e-commerce industry will face a problem under normal circumstances, that is, the pressure during the big promotion period is very large. The Internet environment is complex, the order volume, data traffic is unpredictable, and there are even some competitors with malicious behavior. This requires the technical staff to be very prepared in response to the big promotion, and wait and see. In this regard , Jiuxian.com is generally the one who does this . Every time before the promotion, there will be no less than seven or eight people in the data command group. Each team will also draw out special docking personnel for business docking. In addition, Jiuxian.com will also prepare data sandbox to flexibly control data dynamics. 2 Technically, there will be some new forms of promotion every time. For example, lottery activities, red packets, every time there is a new form, some old forms will be sorted out, specializing in the organization of business processes. After combing, the performance test will be done uniformly. But before each big promotion, a large performance test will be organized, divided into two parts inside and outside. The internal testing includes performance testing of each fixed module and testing of the integrated business module. After completing the internal performance test, third-party organizations will be invited, such as listening to Cloud Network to stress test the performance of Jiuxian.com to understand the performance of the website and the network request effect on the network node. Listen Cloud Network stress testing may be from different nodes, multiple geographies, concurrent requests between the same time, has a good performance in terms of authenticity and effect.

of

Listen to Cloud Network Stress Test • Listen to Cloud Network stress test can schedule monitoring nodes across the country to monitor target websites/applications at specified times, and periodically increase concurrent concurrency by determining a system bottleneck or unavailable performance points. To obtain the maximum service level test that the system can provide; • Record the key data such as the CPU/ memory value of the source server and network traffic during the stress test , and analyze it appropriately; • Listen to the cloud network 's stress test service. Page, video streaming, and transaction process stress testing. Generally, Jiuxian.com has made some estimates on the flow. For example, the performance of Jiuxian.com is estimated to be 20 million UA . Jiuxian.com will consider 1.5-2 times. The system must meet this requirement. In the process of stress testing, some new problems will be discovered. For example, some business processes are not particularly smooth at the code level, and then the bottleneck code changes will be targeted. In case this business is not solved for a while, for example, sometimes the time is relatively hasty, or other situations occur, then you can only lose the car to protect the handsome, retain some things that have a great impact on business performance, and shield the functions that are not too influential. . 3 Faced with hundreds of times the peak traffic, if the way to increase the server will result in waste of resources, Jiuxian.com adopts a hybrid cloud approach for flexible deployment. 4 Risk assessment mainly includes two aspects, one is the operation and maintenance level, and the other is the procedural level. When there is a safety performance problem in the program, Jiuxian.com will also come up with a corresponding risk assessment plan. If there is a problem, it will close part of the business. At the same time, the plan will be considered well in advance, of course, risk assessment and network optimization are also inseparable.

of

of

3 , in the performance optimization, how to do Jiuxian network? 1 In terms of network optimization, load balancing is in the whole process, especially in the operation of the order system, but when it is promoted, Jiuxian will temporarily increase the load balancing amount. Before the server is not so much, Jiuxian.com The temporary promotion of the promotion will be supplemented - increase the CDN . In peacetime Brewmaster Brewmaster net net will have a CDN, but not so much, usually mainly static content, such as static theme, or CSGS picture will use CDN, dynamic content rarely use this feature. However, during the promotion period, Jiuxian.com will access the CDN in large quantities, and the corresponding CDN will be activated according to the estimated amount . At the same time, in order to ensure that the acceleration effect of CDN can cope with the big peak, Jiuxian.com also uses Listening Cloud Network to evaluate the service quality of CDN . Listen to Cloud Network CDN Distribution Strategy • The distribution strategy of CDN nodes is critical to improving website performance. In addition to the number of nodes in the acceleration effect, the most important is the scientific distribution and configuration of the nodes; • Listening to the Cloud Network will monitor the quality of service of the CDN service provider, and analyze the data scientifically to analyze the rationality of the distribution of CDN nodes to the CDN nodes. The strategy is adjusted. Two pairs of database performance monitoring appliance business no matter what, as long as during the big promotion, performance and availability issues are a top priority for First Brewmaster network will use to listen to a cloud server Server for real-time monitoring, the service can be slow to respond and unavailable to locate, view the slow tracking application and Web application process capabilities, real-time positioning largest consumption of resources and code statements, which can help assist in real-time targeted adjustments and optimization, and can quickly locate a matter of time, the fastest Can go to the minute level. In addition, in the case of high concurrency and server pressure surge, the abnormal probability of normal operation of the server is greatly increased, and the daily performance bottlenecks will be multiplied, which requires real-time positioning and resolution of performance bottlenecks, and advancement. Preventive improvement. In general, the traditional log collection method is time-consuming and labor-intensive, and the effect is very bad. After using the cloud server , Jiuxian.com can perform the 1- minute-level positioning to quickly and effectively find the bottleneck point. At the same time, it also combines the pressure measurement function of Listening Cloud Network , which can detect the bottleneck point under high pressure before the server goes online, prevent it in advance, and avoid the server bottleneck caused by high concurrency. Therefore, when high concurrent large traffic enters, if the performance is not achieved, Jiuxian will adopt a temporary solution, such as FIO card, load hard disk, and slow down the database pressure, or increase the amount of cache. There are some key services, the cache time is short, and some services may not need to be cached. At this time, if the estimate exceeds the system load, then the use of the cache can be increased and the time can be extended. There are many computer rooms in the system of Jiuxian.com, which will be distributed throughout the country. At the same time, the Internet environment during the big promotion period is more complicated, which leads to the uncertainty of the failure that may occur. For example, the double eleven, all major e-commerce companies do e-commerce, the efficiency of the entire Internet is lagging behind. So in the computer room across the country , there may be data delay problems. At this time, Jiuxian.com will use the listening cloud network for real-time monitoring. For example, if Jiuxian Network finds that there is a fault in the node by listening to Cloud Network , then it will immediately perform failover and temporarily not use this node. For example, there may be some problems with CDN in some places. Some places will not. Jiuxian.com will replace this problematic machine and switch to another computer room. In general, two days before the big promotion, someone will stare at the development of the whole process in real time. The data sandbox will be used during the 4 major promotion period. Every time there is a big data, there is a data about the entire dynamic process. This dynamic is not completely real-time, but it is basically real-time. Through the sand table, Jiuxian.com can see the operation of the system, which can provide real-time response for the sales work. For example, which place sells wine well, and where the promotion needs to be adjusted, Jiuxian.com will monitor the data sandbox real-time adjustment strategy in real time. 4 , other want to talk about 1 how to deal with complex business models, Jiuxian.com believes that now whether it is the underlying architecture, or the data level to build a cross-company big data platform, such as warehouse platform, operation management platform, storage platform, supply chain The system, as well as supplier management, sales forecasting, inventory allocation and other requirements, have gradually begun to build up with big data methods. Jiuxian.com implemented an algorithm-oriented intelligent treatment. For example , when Moutai is out of stock every year in January , if it does not make Moutai reserves before January , it is likely to cause 3000-5000. The loss of 10,000. Therefore, Jiuxian.com has taken the storage management, sales forecast and inventory allocation of big data and carried out self-development. Similar to this traditional business, Jiuxian.com does not use a third party, because its goal is to become a billion-dollar e-commerce company, so whether it is from the layout of the business, the choice of personnel or the establishment of the company is in accordance with that The standard is conceived, so it is necessary to cultivate their own technical strength, specialized talents, and then these people will support the wine cents network to become a billion-dollar company. 2 Faced with new technologies, such as microservices, Jiuxian.com has been discussing it, but it has not yet formed a large scope. Micro-services or SOA , no matter what kind of e-commerce company, entrepreneurial company, or the current scale of Jiuxian.com, or Dangdang, Jingdong, are all necessary to go. Whether it is from project management, technical management or operation and maintenance deployment management, in the face of such fast-growing traffic, constant iterative changes, and hundreds of thousands of teamwork divisions, it is necessary to go The process of service. In fact, in the past six months, Jiuxian.com has been adjusting its service structure and e-commerce business. It is hoped that the service of the store and shopping system will be able to go online in the first stage before the peak season. For Docker 's scheduling deployment , it is also related to the hybrid cloud of Jiuxian.com, so I spent a lot of energy in this area to study and explore how to do rapid deployment and flexible deployment.

Editor in charge: Xing Xingchen

Bedding Sets

Velvet Duvet ,Polyester Duvet Cover,100 Cotton Bedding,Cotton Quilt

Nantong NATASHA Textiles Co.,Ltd. , http://www.ntnatashatextile.com

Posted on