sysfs-class-rtrs-client 6.4 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146
  1. What: /sys/class/rtrs-client
  2. Date: Feb 2020
  3. KernelVersion: 5.7
  4. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  5. Description: When a user of RTRS API creates a new session, a directory entry with
  6. the name of that session is created under /sys/class/rtrs-client/<session-name>/
  7. What: /sys/class/rtrs-client/<session-name>/add_path
  8. Date: Feb 2020
  9. KernelVersion: 5.7
  10. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  11. Description: RW, adds a new path (connection) to an existing session. Expected format is the
  12. following::
  13. <[source addr,]destination addr>
  14. *addr ::= [ ip:<ipv4|ipv6> | gid:<gid> ]
  15. What: /sys/class/rtrs-client/<session-name>/max_reconnect_attempts
  16. Date: Feb 2020
  17. KernelVersion: 5.7
  18. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  19. Description: Maximum number reconnect attempts the client should make before giving up
  20. after connection breaks unexpectedly.
  21. What: /sys/class/rtrs-client/<session-name>/mp_policy
  22. Date: Feb 2020
  23. KernelVersion: 5.7
  24. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  25. Description: Multipath policy specifies which path should be selected on each IO:
  26. round-robin (0):
  27. select path in per CPU round-robin manner.
  28. min-inflight (1):
  29. select path with minimum inflights.
  30. min-latency (2):
  31. select path with minimum latency.
  32. What: /sys/class/rtrs-client/<session-name>/paths/
  33. Date: Feb 2020
  34. KernelVersion: 5.7
  35. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  36. Description: Each path belonging to a given session is listed here by its source and
  37. destination address. When a new path is added to a session by writing to
  38. the "add_path" entry, a directory <src@dst> is created.
  39. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/state
  40. Date: Feb 2020
  41. KernelVersion: 5.7
  42. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  43. Description: RO, Contains "connected" if the session is connected to the peer and fully
  44. functional. Otherwise the file contains "disconnected"
  45. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/reconnect
  46. Date: Feb 2020
  47. KernelVersion: 5.7
  48. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  49. Description: Write "1" to the file in order to reconnect the path.
  50. Operation is blocking and returns 0 if reconnect was successful.
  51. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/disconnect
  52. Date: Feb 2020
  53. KernelVersion: 5.7
  54. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  55. Description: Write "1" to the file in order to disconnect the path.
  56. Operation blocks until RTRS path is disconnected.
  57. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/remove_path
  58. Date: Feb 2020
  59. KernelVersion: 5.7
  60. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  61. Description: Write "1" to the file in order to disconnected and remove the path
  62. from the session. Operation blocks until the path is disconnected
  63. and removed from the session.
  64. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/hca_name
  65. Date: Feb 2020
  66. KernelVersion: 5.7
  67. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  68. Description: RO, Contains the name of HCA the connection established on.
  69. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/hca_port
  70. Date: Feb 2020
  71. KernelVersion: 5.7
  72. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  73. Description: RO, Contains the port number of active port traffic is going through.
  74. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/src_addr
  75. Date: Feb 2020
  76. KernelVersion: 5.7
  77. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  78. Description: RO, Contains the source address of the path
  79. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/dst_addr
  80. Date: Feb 2020
  81. KernelVersion: 5.7
  82. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  83. Description: RO, Contains the destination address of the path
  84. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/cur_latency
  85. Date: Feb 2020
  86. KernelVersion: 5.7
  87. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  88. Description: RO, Contains the latency time calculated by the heart-beat messages.
  89. Whenever the client sends heart-beat message, it checks the time gap
  90. between sending the heart-beat message and receiving the ACK.
  91. This value can be changed regularly.
  92. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/reset_all
  93. Date: Feb 2020
  94. KernelVersion: 5.7
  95. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  96. Description: RW, Read will return usage help, write 0 will clear all the statistics.
  97. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/cpu_migration
  98. Date: Feb 2020
  99. KernelVersion: 5.7
  100. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  101. Description: RTRS expects that each HCA IRQ is pinned to a separate CPU. If it's
  102. not the case, the processing of an I/O response could be processed on a
  103. different CPU than where it was originally submitted. This file shows
  104. how many interrupts where generated on a non expected CPU.
  105. "from:"
  106. is the CPU on which the IRQ was expected, but not generated.
  107. "to:"
  108. is the CPU on which the IRQ was generated, but not expected.
  109. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/reconnects
  110. Date: Feb 2020
  111. KernelVersion: 5.7
  112. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  113. Description: Contains 2 unsigned int values, the first one records number of successful
  114. reconnects in the path lifetime, the second one records number of failed
  115. reconnects in the path lifetime.
  116. What: /sys/class/rtrs-client/<session-name>/paths/<src@dst>/stats/rdma
  117. Date: Feb 2020
  118. KernelVersion: 5.7
  119. Contact: Jack Wang <[email protected]> Danil Kipnis <[email protected]>
  120. Description: Contains statistics regarding rdma operations and inflight operations.
  121. The output consists of 6 values::
  122. <read-count> <read-total-size> <write-count> \
  123. <write-total-size> <inflights> <failovered>